Jun 27 04:21:54 devstack cinder-volume[82236]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 27 04:21:54 devstack cinder-volume[82236]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 04:21:54 devstack cinder-volume[82236]: we strongly recommend against using it for new projects. Jun 27 04:21:54 devstack cinder-volume[82236]: If you are already using Eventlet, we recommend migrating to a different Jun 27 04:21:54 devstack cinder-volume[82236]: framework. For more detail see Jun 27 04:21:54 devstack cinder-volume[82236]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 04:21:54 devstack cinder-volume[82236]: import eventlet # noqa Jun 27 04:21:57 devstack cinder-volume[82236]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:21:57 devstack cinder-volume[82236]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:21:57 devstack cinder-volume[82236]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:21:58 devstack cinder-volume[82236]: INFO dbcounter [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Registered counter for database cinder Jun 27 04:21:58 devstack cinder-volume[82236]: DEBUG oslo_db.sqlalchemy.engines [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:21:58 devstack cinder-volume[82236]: DEBUG dbcounter [-] [82236] Writer thread running {{(pid=82236) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 04:21:58 devstack cinder-volume[82236]: INFO cinder.rpc [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 27 04:21:58 devstack cinder-volume[82236]: INFO cinder.rpc [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 27 04:21:58 devstack cinder-volume[82236]: DEBUG oslo_db.sqlalchemy.engines [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:21:58 devstack cinder-volume[82236]: INFO cinder.volume.manager [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Determined volume DB was empty at startup. Jun 27 04:21:58 devstack cinder-volume[82236]: DEBUG cinder.volume.manager [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82236) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 27 04:21:58 devstack cinder-volume[82236]: INFO cinder.volume.manager [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 27 04:21:58 devstack cinder-volume[82236]: WARNING stevedore.named [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 04:21:58 devstack cinder-volume[82236]: WARNING castellan.key_manager [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:21:58 devstack cinder-volume[82236]: WARNING cinder.keymgr.conf_key_mgr [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:21:58 devstack cinder-volume[82236]: DEBUG cinder.volume.drivers.lvm [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82236) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 27 04:21:58 devstack cinder-volume[82236]: DEBUG oslo_concurrency.processutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82236) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_concurrency.processutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] CMD "cinder-rtstool verify" returned: 0 in 0.539s {{(pid=82236) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_db.sqlalchemy.engines [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:21:59 devstack cinder-volume[82236]: INFO cinder.rpc [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 27 04:21:59 devstack cinder-volume[82236]: INFO cinder.rpc [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 27 04:21:59 devstack cinder-volume[82236]: WARNING stevedore.named [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 04:21:59 devstack cinder-volume[82236]: WARNING castellan.key_manager [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:21:59 devstack cinder-volume[82236]: INFO cinder.volume.manager [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_db.sqlalchemy.engines [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82236) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:21:59 devstack cinder-volume[82236]: INFO oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Starting 1 workers Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Started child 82443 {{(pid=82236) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Full set of CONF: {{(pid=82236) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] ******************************************************************************** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Configuration options gathered from: {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] ================================================================================ {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] allow_availability_zone_fallback = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] allow_compression_on_image_upload = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] allowed_direct_url_schemes = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] api_rate_limit = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] auth_strategy = keystone {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] az_cache_duration = 3600 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_availability_zone = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_host = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_stats_polling_interval = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backup_api_class = cinder.backup.api.API {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backup_name_template = backup-%s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82443]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.1) Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backup_use_same_host = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backup_use_temp_snapshot = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] chap_password = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] chap_username = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_internal_tenant_project_id = a27c50f98afb4d85aeb8af07e076a322 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_internal_tenant_user_id = c9e4e4d62551441dbe0b87c53054a768 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cloned_volume_same_az = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cluster = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] compression_format = gzip {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] compute_api_class = cinder.compute.nova.API {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] config_dir = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] config_source = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] control_exchange = openstack {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] debug = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] default_availability_zone = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] default_group_type = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] default_volume_type = lvmdriver-1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] disk_geometry = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] driver_client_cert = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] driver_client_cert_key = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] driver_data_namespace = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] driver_ssl_cert_path = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] driver_ssl_cert_verify = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] driver_use_ssl = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] enable_force_upload = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] enable_new_services = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] enable_unsupported_driver = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] enabled_backends = ['lvmdriver-1'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] enforce_multipath_for_image_xfer = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] filter_function = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_api_insecure = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_api_ssl_compression = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_ca_certificates_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_catalog_info = image:glance:publicURL {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_num_retries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance_request_timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] goodness_function = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] graceful_shutdown_timeout = 5 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] group_api_class = cinder.group.api.API {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] host = devstack {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_compress_on_upload = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_conversion_address_space_limit = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_conversion_cpu_limit = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_conversion_disable = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_upload_use_cinder_backend = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_upload_use_internal_tenant = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_volume_cache_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_volume_cache_max_count = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] image_volume_cache_max_size_gb = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] init_host_max_objects_retrieval = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] instance_format = [instance: %(uuid)s] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] iscsi_target_flags = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] iscsi_write_cache = on {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] iser_helper = tgtadm {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] iser_ip_address = 192.168.122.7 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] iser_port = 3260 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_color = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_config_append = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_dir = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_options = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_rotate_interval = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_rotate_interval_type = days {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] log_rotation_type = none {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] max_age = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] max_logfile_count = 30 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] max_logfile_size_mb = 200 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] max_over_subscription_ratio = 20.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] message_reap_interval = 86400 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] message_ttl = 2592000 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] migration_create_volume_timeout_secs = 300 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] monkey_patch = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] monkey_patch_modules = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] my_ip = 192.168.122.7 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] no_snapshot_gb_quota = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] num_iser_scan_tries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] num_shell_tries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] num_volume_device_scan_tries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] nvmeof_conn_info_version = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] nvmet_ns_id = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] nvmet_port_id = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_max_limit = 1000 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_volume_ext_list = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_volume_listen = 0.0.0.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_volume_listen_port = 8776 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_volume_use_ssl = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] osapi_volume_workers = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] per_volume_size_limit = -1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] periodic_fuzzy_delay = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] periodic_interval = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] project_id_regex = [0-9a-f\-]+ {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] public_endpoint = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] publish_errors = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_backup_gigabytes = 1000 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_backups = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_gigabytes = 1000 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_groups = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_snapshots = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] quota_volumes = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] rate_limit_burst = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] rate_limit_except_level = CRITICAL {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] rate_limit_interval = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] reinit_driver_count = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] replication_device = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] report_discard_supported = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] report_interval = 120 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] reservation_clean_interval = 86400 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] reservation_expire = 86400 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] reserved_image_namespaces = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] reserved_percentage = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] rpc_response_timeout = 120 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] run_external_periodic_tasks = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] scst_target_driver = iscsi {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] scst_target_iqn_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_down_time = 720 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] shell_completion = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] snapshot_name_template = snapshot-%s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] snapshot_same_host = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82443]: INFO cinder.volume.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] split_loggers = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] state_path = /opt/stack/data/cinder {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] storage_availability_zone = nova {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] storage_protocol = iSCSI {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] syslog_log_facility = LOG_USER {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] target_helper = lioadm {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] target_ip_address = 192.168.122.7 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] target_port = 3260 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] target_protocol = iscsi {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] target_secondary_ip_addresses = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] trace_flags = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] transfer_api_class = cinder.transfer.api.API {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] transport_url = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] until_refresh = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_chap_auth = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_default_quota_class = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_journal = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_json = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_multipath_for_image_xfer = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_stderr = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] use_syslog = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] verify_glance_signatures = enabled {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_api_class = cinder.volume.api.API {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_backend_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_clear = zero {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_clear_ionice = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_clear_size = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_copy_bps_limit = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_dd_blocksize = 1M {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_name_template = volume-%s {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_service_inithost_offload = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volume_usage_audit_period = month {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] zoning_mode = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_concurrency.disable_process_locking = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.auth_section = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.auth_type = password {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.auth_version = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.cache = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.include_service_catalog = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.insecure = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.interface = public {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_password = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcache_username = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.region_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.service_token_roles_required = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.service_type = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.backend = dogpile.cache.null {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.backend_argument = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.backend_expiration_time = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.config_prefix = cache.oslo {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.debug_cache_backend = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.enable_retry_client = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.enable_socket_keepalive = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.expiration_time = 600 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.hashclient_retry_attempts = 2 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_dead_retry = 300 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_pool_maxsize = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_sasl_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.password = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.proxies = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.redis_db = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.redis_server = localhost:6379 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.retry_attempts = 2 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.retry_delay = 0.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.socket_keepalive_count = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.socket_keepalive_idle = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.socket_keepalive_interval = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.socket_timeout = 1.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.tls_allowed_ciphers = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.tls_cafile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.tls_certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.tls_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.tls_keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cache.username = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] coordination.backend_url = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.asyncio_connection = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.asyncio_slave_connection = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.backend = sqlalchemy {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.connection = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.connection_debug = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.connection_parameters = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.connection_recycle_time = 3600 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.connection_trace = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.db_inc_retry_interval = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.db_max_retries = 20 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.db_max_retry_interval = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.db_retry_interval = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.max_overflow = 50 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.max_pool_size = 5 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.max_retries = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.mysql_wsrep_sync_wait = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.pool_timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.retry_interval = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.slave_connection = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.sqlite_synchronous = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.synchronous_reader = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] database.use_db_reconnect = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.connection_string = messaging:// {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.es_doc_type = notification {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.es_scroll_size = 10000 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.es_scroll_time = 2m {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.filter_error_trace = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.hmac_keys = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.sentinel_service_name = mymaster {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.socket_timeout = 0.1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.trace_requests = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler.trace_sqlalchemy = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler_jaeger.process_tags = {} {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler_jaeger.service_name_prefix = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] profiler_otlp.service_name_prefix = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.enforce_new_defaults = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: WARNING oslo_config.cfg [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.enforce_scope = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.policy_default_rule = default {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.policy_file = policy.yaml {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_policy.remote_timeout = 60.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.group = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.helper_command = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] privsep_osbrick.user = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.group = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.helper_command = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] cinder_sys_admin.user = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.auth_section = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.auth_type = password {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.cafile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.collect_timing = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.insecure = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.send_service_user_token = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.split_loggers = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] service_user.timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.auth_section = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.auth_type = password {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.collect_timing = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.insecure = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.region_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.split_loggers = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] glance.timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.backend_availability_zone = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.chap_password = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.chap_username = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.disk_geometry = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.driver_client_cert = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.driver_client_cert_key = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.driver_data_namespace = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.driver_use_ssl = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.extra_capabilities = {} {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.filter_function = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.goodness_function = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.iscsi_target_flags = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.iscsi_write_cache = on {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.iser_helper = tgtadm {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.iser_port = 3260 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.lvm_mirrors = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.lvm_share_target = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.lvm_type = auto {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.num_shell_tries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.replication_device = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.report_discard_supported = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.reserved_percentage = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.target_helper = tgtadm {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.target_port = 3260 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.target_protocol = iscsi {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.trace_flags = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.unique_fqdn_network = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.use_chap_auth = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_backend_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_clear = zero {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_clear_ionice = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_clear_size = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volume_group = cinder-volumes {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_reports.file_event_handler = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_reports.log_dir = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.backend_availability_zone = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.backend_host = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.chap_password = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.chap_username = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.chiscsi_conf = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.disk_geometry = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.driver_client_cert = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.driver_data_namespace = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.driver_use_ssl = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.extra_capabilities = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.filter_function = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.goodness_function = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.iser_helper = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.iser_ip_address = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.iser_port = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.iser_target_prefix = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.lvm_conf_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.lvm_mirrors = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.lvm_share_target = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.lvm_type = auto {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.num_shell_tries = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.nvmet_port_id = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.replication_device = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.report_discard_supported = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.reserved_percentage = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.scst_target_driver = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.storage_protocol = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.target_helper = lioadm {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.target_ip_address = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.target_port = 3260 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.target_protocol = iscsi {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.trace_flags = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.use_chap_auth = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_clear = zero {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_clear_size = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] lvmdriver-1.volumes_dir = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.ssl_version = {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_notifications.driver = [] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_notifications.retry = -1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] key_manager.fixed_key = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.barbican_api_version = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.barbican_endpoint = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.barbican_endpoint_type = public {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.barbican_region_name = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.cafile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack sudo[82448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.collect_timing = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.insecure = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack sudo[82448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.number_of_retries = 60 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.retry_delay = 1 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.send_service_user_token = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.split_loggers = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.verify_ssl = True {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican.verify_ssl_path = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.auth_section = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.auth_type = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.cafile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.certfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.collect_timing = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.insecure = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.keyfile = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.split_loggers = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] barbican_service_user.timeout = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.approle_role_id = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.approle_secret_id = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.kv_mountpoint = secret {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.kv_path = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.kv_version = 2 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.namespace = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.root_token_id = **** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.ssl_ca_crt_file = None {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.timeout = 60.0 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.use_ssl = False {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:21:59 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] ******************************************************************************** {{(pid=82236) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 27 04:22:00 devstack sudo[82448]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:00 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:00 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:00 devstack sudo[82724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:00 devstack sudo[82724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:01 devstack sudo[82724]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:01 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.667s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:01 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:22:01 devstack cinder-volume[82443]: INFO cinder.brick.local_dev.lvm [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 27 04:22:01 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:01 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:01 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:01 devstack sudo[82926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:22:01 devstack sudo[82926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:02 devstack sudo[82926]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:02 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.942s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:02 devstack cinder-volume[82443]: DEBUG cinder.brick.local_dev.lvm [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82443) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 27 04:22:02 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:02 devstack sudo[83092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:02 devstack sudo[83092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:03 devstack sudo[83092]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:03 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.083s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:03 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:03 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:03 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:03 devstack sudo[83223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:03 devstack sudo[83223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:03 devstack sudo[83223]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:04 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:04 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:04 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:04 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:04 devstack sudo[83228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 27 04:22:04 devstack sudo[83228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:04 devstack sudo[83228]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:04 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.705s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:04 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:04 devstack sudo[83232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:22:04 devstack sudo[83232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:05 devstack sudo[83232]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:05 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:05 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:05 devstack sudo[83236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:22:05 devstack sudo[83236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:06 devstack sudo[83236]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.785s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:06 devstack sudo[83241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:06 devstack sudo[83241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:07 devstack sudo[83241]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.001s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:07 devstack sudo[83254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:07 devstack sudo[83254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:07 devstack sudo[83254]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:07 devstack sudo[83261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:07 devstack sudo[83261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:08 devstack sudo[83261]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:08 devstack cinder-volume[82443]: INFO cinder.volume.drivers.lvm [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 27 04:22:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:08 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:08 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:09 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.924s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:09 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:22:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:09 devstack sudo[83384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:22:09 devstack sudo[83384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:09 devstack cinder-volume[82236]: DEBUG dbcounter [-] [82236] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82236) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:22:10 devstack sudo[83384]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:10 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:10 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:10 devstack sudo[83482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:10 devstack sudo[83482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:10 devstack sudo[83482]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:10 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:10 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:10 devstack sudo[83534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:10 devstack sudo[83534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:11 devstack sudo[83534]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:11 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:11 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:11 devstack sudo[83537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:11 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:12 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:12 devstack cinder-volume[82443]: INFO cinder.volume.driver [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Driver hasn't implemented _init_vendor_properties() Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG cinder.volume.driver [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82443) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG oslo_db.sqlalchemy.engines [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82443) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG dbcounter [-] [82443] Writer thread running {{(pid=82443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG cinder.db.sqlalchemy.api [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Building query based on filter {{(pid=82443) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG cinder.image.image_utils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82443) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 27 04:22:12 devstack cinder-volume[82443]: INFO cinder.keymgr.migration [None req-e0f90795-2ab9-449d-b0fd-9f946dffbb7a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:22:12 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:12 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:22:12 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:13 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:13 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:13 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:13 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:13 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:13 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:13 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:13 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:13 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:13 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:14 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:14 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:14 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:14 devstack sudo[83554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:14 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:15 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:15 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.748s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:15 devstack cinder-volume[82443]: DEBUG cinder.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Notifying Schedulers of capabilities ... {{(pid=82443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:22:15 devstack cinder-volume[82443]: INFO cinder.volume.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Driver initialization completed successfully. Jun 27 04:22:15 devstack cinder-volume[82443]: INFO cinder.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Initiating service 2 cleanup Jun 27 04:22:15 devstack cinder-volume[82443]: INFO cinder.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Service 2 cleanup completed. Jun 27 04:22:15 devstack cinder-volume[82443]: DEBUG cinder.service [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Creating RPC server for service cinder-volume {{(pid=82443) start /opt/stack/cinder/cinder/service.py:231}} Jun 27 04:22:15 devstack cinder-volume[82443]: DEBUG cinder.service [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82443) start /opt/stack/cinder/cinder/service.py:237}} Jun 27 04:22:15 devstack cinder-volume[82443]: INFO cinder.volume.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 27 04:22:15 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:22:15 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:15 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:22:15 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:16 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:16 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:16 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:16 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:16 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:16 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:16 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:16 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:16 devstack sudo[83571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:22:16 devstack sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:17 devstack sudo[83571]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:17 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.753s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:17 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:22:17 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:22:17 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:22:18 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Jun 27 04:22:18 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:22:18 devstack cinder-volume[82443]: INFO cinder.volume.manager [None req-34fe19eb-d45c-4dfc-80c3-87b99b3dccb8 None None] Driver post RPC initialization completed successfully. Jun 27 04:22:25 devstack cinder-volume[82443]: DEBUG dbcounter [-] [82443] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:22:28 devstack cinder-volume[82443]: DEBUG dbcounter [-] [82443] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:23:06 devstack cinder-volume[82443]: DEBUG oslo_service.periodic_task [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82443) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:23:06 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:23:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:23:06 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:23:06 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:23:07 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Jun 27 04:23:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:23:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:23:07 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:23:07 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:23:07 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Jun 27 04:23:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:23:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:23:07 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:23:07 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:23:08 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Jun 27 04:23:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.728s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:23:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:23:08 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:23:08 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:23:09 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Jun 27 04:23:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:23:09 devstack cinder-volume[82443]: DEBUG cinder.manager [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Notifying Schedulers of capabilities ... {{(pid=82443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:24:06 devstack cinder-volume[82443]: DEBUG oslo_service.periodic_task [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82443) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:24:06 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:24:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:24:06 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:24:06 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:24:07 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Jun 27 04:24:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:24:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:24:07 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:24:07 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:24:07 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Jun 27 04:24:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:24:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:24:07 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:24:07 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:24:08 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Jun 27 04:24:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:24:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:24:08 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:24:08 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:24:09 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Jun 27 04:24:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:24:09 devstack cinder-volume[82443]: DEBUG cinder.manager [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Notifying Schedulers of capabilities ... {{(pid=82443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:24:28 devstack cinder-volume[82443]: DEBUG dbcounter [-] [82443] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:25:06 devstack cinder-volume[82443]: DEBUG oslo_service.periodic_task [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82443) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:25:06 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:25:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:25:06 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:25:06 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:25:07 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Jun 27 04:25:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:25:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:25:07 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:25:07 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:25:07 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Jun 27 04:25:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:25:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:25:07 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:25:07 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:25:08 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Jun 27 04:25:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:25:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:25:08 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:25:08 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:25:09 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Jun 27 04:25:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:25:09 devstack cinder-volume[82443]: DEBUG cinder.manager [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Notifying Schedulers of capabilities ... {{(pid=82443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:26:06 devstack cinder-volume[82443]: DEBUG oslo_service.periodic_task [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82443) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:26:06 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:26:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:26:06 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:26:06 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:26:07 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Jun 27 04:26:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:26:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:26:07 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:26:07 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:26:07 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jun 27 04:26:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:26:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:26:07 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:26:07 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:26:08 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Jun 27 04:26:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:26:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:26:08 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:26:08 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:26:09 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Jun 27 04:26:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:26:09 devstack cinder-volume[82443]: DEBUG cinder.manager [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Notifying Schedulers of capabilities ... {{(pid=82443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:26:28 devstack cinder-volume[82443]: DEBUG dbcounter [-] [82443] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:27:06 devstack cinder-volume[82443]: DEBUG oslo_service.periodic_task [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82443) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:27:06 devstack cinder-volume[82443]: DEBUG cinder.volume.drivers.lvm [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Updating volume stats {{(pid=82443) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 27 04:27:06 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:06 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 27 04:27:06 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:07 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:07 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:27:07 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:07 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:07 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:07 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 27 04:27:07 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:08 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:08 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:08 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 27 04:27:08 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:09 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:09 devstack cinder-volume[82443]: DEBUG oslo_concurrency.processutils [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=82443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:09 devstack cinder-volume[82443]: DEBUG cinder.manager [None req-94b348b3-b7bc-4971-ac15-b06de60326c5 None None] Notifying Schedulers of capabilities ... {{(pid=82443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:27:22 devstack cinder-volume[82236]: INFO oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Caught SIGTERM, stopping children Jun 27 04:27:22 devstack cinder-volume[82236]: DEBUG oslo_concurrency.lockutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Acquiring lock "singleton_lock" {{(pid=82236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:27:22 devstack cinder-volume[82236]: DEBUG oslo_concurrency.lockutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Acquired lock "singleton_lock" {{(pid=82236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:27:22 devstack cinder-volume[82236]: DEBUG oslo_concurrency.lockutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Releasing lock "singleton_lock" {{(pid=82236) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:27:22 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Stop services. {{(pid=82236) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 27 04:27:22 devstack cinder-volume[82236]: DEBUG oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Killing children. {{(pid=82236) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 27 04:27:22 devstack cinder-volume[82236]: INFO oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Waiting on 1 children to exit Jun 27 04:27:25 devstack cinder-volume[82443]: DEBUG oslo_concurrency.lockutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Acquiring lock "singleton_lock" {{(pid=82443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:27:25 devstack cinder-volume[82443]: DEBUG oslo_concurrency.lockutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Acquired lock "singleton_lock" {{(pid=82443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:27:25 devstack cinder-volume[82443]: DEBUG oslo_concurrency.lockutils [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Releasing lock "singleton_lock" {{(pid=82443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:27:25 devstack cinder-volume[82443]: WARNING amqp [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 04:27:25 devstack cinder-volume[82443]: WARNING amqp [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 04:27:25 devstack cinder-volume[82236]: INFO oslo_service.backend._eventlet.service [None req-c271bd26-b4e7-4ca4-84ad-8568a2c246cb None None] Child 82443 exited with status 0 Jun 27 04:27:25 devstack cinder-volume[92972]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 27 04:27:25 devstack cinder-volume[92972]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 04:27:25 devstack cinder-volume[92972]: we strongly recommend against using it for new projects. Jun 27 04:27:25 devstack cinder-volume[92972]: If you are already using Eventlet, we recommend migrating to a different Jun 27 04:27:25 devstack cinder-volume[92972]: framework. For more detail see Jun 27 04:27:25 devstack cinder-volume[92972]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 04:27:25 devstack cinder-volume[92972]: import eventlet # noqa Jun 27 04:27:28 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:27:28 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:27:28 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:27:28 devstack cinder-volume[92972]: INFO dbcounter [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Registered counter for database cinder Jun 27 04:27:28 devstack cinder-volume[92972]: DEBUG oslo_db.sqlalchemy.engines [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG dbcounter [-] [92972] Writer thread running {{(pid=92972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 04:27:29 devstack cinder-volume[92972]: INFO cinder.rpc [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 27 04:27:29 devstack cinder-volume[92972]: INFO cinder.rpc [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_db.sqlalchemy.engines [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:29 devstack cinder-volume[92972]: INFO cinder.volume.manager [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Determined volume DB was empty at startup. Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG cinder.volume.manager [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92972) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 27 04:27:29 devstack cinder-volume[92972]: INFO cinder.volume.manager [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 27 04:27:29 devstack cinder-volume[92972]: WARNING stevedore.named [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 04:27:29 devstack cinder-volume[92972]: WARNING castellan.key_manager [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:27:29 devstack cinder-volume[92972]: WARNING cinder.keymgr.conf_key_mgr [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:27:29 devstack cinder-volume[92972]: INFO cinder.volume.manager [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_db.sqlalchemy.engines [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:29 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Starting 1 workers Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Started child 93191 {{(pid=92972) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 27 04:27:29 devstack cinder-volume[93191]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.1) Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Full set of CONF: {{(pid=92972) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] ******************************************************************************** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Configuration options gathered from: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] ================================================================================ {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] allow_availability_zone_fallback = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] allow_compression_on_image_upload = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] allowed_direct_url_schemes = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] api_rate_limit = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] auth_strategy = keystone {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_host = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_stats_polling_interval = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backup_api_class = cinder.backup.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backup_name_template = backup-%s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backup_use_same_host = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backup_use_temp_snapshot = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] chap_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] chap_username = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_internal_tenant_project_id = a27c50f98afb4d85aeb8af07e076a322 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_internal_tenant_user_id = c9e4e4d62551441dbe0b87c53054a768 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cluster = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] compression_format = gzip {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] compute_api_class = cinder.compute.nova.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] config_dir = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] config_source = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] control_exchange = openstack {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] debug = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] default_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] default_group_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] default_volume_type = QuobyteHD {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] disk_geometry = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] driver_client_cert = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] driver_client_cert_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] driver_data_namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] driver_ssl_cert_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] driver_ssl_cert_verify = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] driver_use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] enable_new_services = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] enable_unsupported_driver = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] enabled_backends = ['QuobyteHD'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] enforce_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] filter_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_api_insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_api_ssl_compression = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_ca_certificates_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_catalog_info = image:glance:publicURL {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_num_retries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance_request_timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] goodness_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] graceful_shutdown_timeout = 5 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] group_api_class = cinder.group.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] host = devstack {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_compress_on_upload = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_conversion_address_space_limit = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_conversion_cpu_limit = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_conversion_disable = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_upload_use_cinder_backend = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_upload_use_internal_tenant = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_volume_cache_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_volume_cache_max_count = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] image_volume_cache_max_size_gb = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] init_host_max_objects_retrieval = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] instance_format = [instance: %(uuid)s] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] iscsi_target_flags = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] iscsi_write_cache = on {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] iser_helper = tgtadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] iser_ip_address = 192.168.122.7 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] iser_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_color = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_config_append = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_dir = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_options = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_rotate_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_rotate_interval_type = days {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] log_rotation_type = none {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] max_age = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] max_logfile_count = 30 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] max_logfile_size_mb = 200 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] max_over_subscription_ratio = 20.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] message_reap_interval = 86400 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] message_ttl = 2592000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] migration_create_volume_timeout_secs = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] monkey_patch = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] monkey_patch_modules = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] my_ip = 192.168.122.7 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] no_snapshot_gb_quota = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] num_iser_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] num_shell_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] num_volume_device_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] nvmeof_conn_info_version = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] nvmet_ns_id = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] nvmet_port_id = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_max_limit = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_volume_ext_list = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_volume_listen_port = 8776 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_volume_use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] osapi_volume_workers = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] per_volume_size_limit = -1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] periodic_fuzzy_delay = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] periodic_interval = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] public_endpoint = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] publish_errors = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_backup_gigabytes = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_backups = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_gigabytes = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_groups = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_snapshots = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] quota_volumes = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] rate_limit_burst = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] rate_limit_except_level = CRITICAL {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] rate_limit_interval = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] reinit_driver_count = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] replication_device = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] report_discard_supported = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] report_interval = 120 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[93191]: INFO cinder.volume.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] reservation_clean_interval = 86400 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.remotefs [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93191) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] reservation_expire = 86400 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] reserved_image_namespaces = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] reserved_percentage = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] rpc_response_timeout = 120 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] run_external_periodic_tasks = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] scst_target_driver = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] scst_target_iqn_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_down_time = 720 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] shell_completion = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] snapshot_name_template = snapshot-%s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] state_path = /opt/stack/data/cinder {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] storage_availability_zone = nova {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] storage_protocol = iSCSI {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] syslog_log_facility = LOG_USER {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] target_helper = lioadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] target_ip_address = 192.168.122.7 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] target_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] target_protocol = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] target_secondary_ip_addresses = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] trace_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] transport_url = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] until_refresh = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_chap_auth = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_default_quota_class = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_journal = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_json = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_stderr = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] use_syslog = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] verify_glance_signatures = enabled {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_api_class = cinder.volume.api.API {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_backend_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_clear = zero {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_clear_ionice = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_clear_size = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_copy_bps_limit = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_dd_blocksize = 1M {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_name_template = volume-%s {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_service_inithost_offload = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volume_usage_audit_period = month {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] zoning_mode = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_concurrency.disable_process_locking = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.auth_type = password {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.auth_version = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.cache = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.include_service_catalog = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.interface = public {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_password = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcache_username = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.region_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.service_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.backend = dogpile.cache.null {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.backend_argument = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.backend_expiration_time = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.config_prefix = cache.oslo {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.debug_cache_backend = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.enable_retry_client = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.enable_socket_keepalive = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.expiration_time = 600 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.hashclient_retry_attempts = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_dead_retry = 300 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_pool_maxsize = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_sasl_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.proxies = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.redis_db = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.redis_server = localhost:6379 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.retry_attempts = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.retry_delay = 0.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.socket_keepalive_count = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.socket_keepalive_idle = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.socket_keepalive_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.socket_timeout = 1.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.tls_allowed_ciphers = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.tls_cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.tls_certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.tls_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.tls_keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cache.username = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] coordination.backend_url = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.asyncio_connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.asyncio_slave_connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.backend = sqlalchemy {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.connection_debug = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.connection_parameters = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.connection_recycle_time = 3600 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.connection_trace = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.db_inc_retry_interval = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.db_max_retries = 20 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.db_max_retry_interval = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.db_retry_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.max_overflow = 50 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.max_pool_size = 5 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.max_retries = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.mysql_wsrep_sync_wait = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.pool_timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.retry_interval = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.slave_connection = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.sqlite_synchronous = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.synchronous_reader = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] database.use_db_reconnect = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.connection_string = messaging:// {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.es_doc_type = notification {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.es_scroll_size = 10000 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.es_scroll_time = 2m {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.filter_error_trace = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.hmac_keys = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.sentinel_service_name = mymaster {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.socket_timeout = 0.1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.trace_requests = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler.trace_sqlalchemy = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler_jaeger.process_tags = {} {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler_jaeger.service_name_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] profiler_otlp.service_name_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.enforce_new_defaults = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: WARNING oslo_config.cfg [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.enforce_scope = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.policy_default_rule = default {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.policy_file = policy.yaml {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.group = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.helper_command = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] privsep_osbrick.user = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.group = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.helper_command = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] cinder_sys_admin.user = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.auth_type = password {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.send_service_user_token = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] service_user.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.auth_type = password {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.region_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] glance.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.backend_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.chap_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.chap_username = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.disk_geometry = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.driver_client_cert = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.driver_client_cert_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.driver_data_namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.driver_use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.extra_capabilities = {} {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.filter_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.goodness_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.iscsi_target_flags = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.iscsi_write_cache = on {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.iser_helper = tgtadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.iser_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_host = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_login = admin {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_mount_options = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_private_key = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_share_path = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93191) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 27 04:27:29 devstack cinder-volume[93191]: WARNING cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 27 04:27:29 devstack cinder-volume[93191]: WARNING cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 27 04:27:29 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Running cmd (subprocess): mount.quobyte {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.num_shell_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.quobyte_volume_url = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.replication_device = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.report_discard_supported = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.reserved_percentage = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.target_helper = tgtadm {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.target_port = 3260 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.target_protocol = iscsi {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.trace_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.unique_fqdn_network = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.use_chap_auth = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_backend_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_clear = zero {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_clear_ionice = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_clear_size = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_reports.file_event_handler = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_reports.log_dir = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.backend_availability_zone = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.backend_host = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.chap_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.chap_username = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.chiscsi_conf = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.disk_geometry = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.driver_client_cert = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.driver_data_namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.driver_use_ssl = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.extra_capabilities = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.filter_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.goodness_function = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.iser_helper = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.iser_ip_address = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.iser_port = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.iser_target_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_host = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_login = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_mount_options = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_password = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_private_key = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_share_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_ssh_port = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.num_shell_tries = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.nvmet_port_id = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.replication_device = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.report_discard_supported = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.reserved_percentage = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.scst_target_driver = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.storage_protocol = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.target_helper = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.target_ip_address = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.target_port = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.target_prefix = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.target_protocol = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.trace_flags = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.use_chap_auth = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_clear = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_clear_size = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] QuobyteHD.volumes_dir = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_notifications.driver = [] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_notifications.retry = -1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] key_manager.fixed_key = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.barbican_api_version = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.barbican_endpoint = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.barbican_endpoint_type = public {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.barbican_region_name = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.number_of_retries = 60 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.retry_delay = 1 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.send_service_user_token = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.verify_ssl = True {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican.verify_ssl_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.auth_section = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.auth_type = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.cafile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.certfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.collect_timing = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.insecure = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.keyfile = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.split_loggers = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] barbican_service_user.timeout = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.approle_role_id = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.approle_secret_id = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.kv_mountpoint = secret {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.kv_path = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.kv_version = 2 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.namespace = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.root_token_id = **** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.ssl_ca_crt_file = None {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.timeout = 60.0 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.use_ssl = False {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:29 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] ******************************************************************************** {{(pid=92972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 27 04:27:29 devstack quobyte-client[93193]: Reading configuration file: /etc/quobyte/client.cfg Jun 27 04:27:29 devstack quobyte-client[93193]: Invalid parameters found, error: missing mount point. Jun 27 04:27:29 devstack quobyte-client[93193]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 27 04:27:29 devstack quobyte-client[93193]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:30 devstack cinder-volume[93191]: INFO cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 ... Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 -c /etc/quobyte/client-cinder.cfg {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:30 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 -c /etc/quobyte/client-cinder.cfg Jun 27 04:27:30 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:30 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.780s {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:30 devstack cinder-volume[93191]: INFO cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 succeeded Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.791s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:30 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:30 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:30 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:31 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.673s {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:31 devstack cinder-volume[93191]: INFO cinder.volume.driver [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Driver hasn't implemented _init_vendor_properties() Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG cinder.volume.driver [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.734016418457, 'free_capacity_gb': 1775.734016418457, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93191) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG oslo_db.sqlalchemy.engines [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93191) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG dbcounter [-] [93191] Writer thread running {{(pid=93191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG cinder.db.sqlalchemy.api [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Building query based on filter {{(pid=93191) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG cinder.image.image_utils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93191) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 27 04:27:31 devstack cinder-volume[93191]: INFO cinder.keymgr.migration [None req-cea7ecac-a72b-4606-9857-011055ce5835 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:31 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:31 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:31 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:32 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.641s {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG cinder.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Notifying Schedulers of capabilities ... {{(pid=93191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:27:32 devstack cinder-volume[93191]: INFO cinder.volume.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Driver initialization completed successfully. Jun 27 04:27:32 devstack cinder-volume[93191]: INFO cinder.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Initiating service 3 cleanup Jun 27 04:27:32 devstack cinder-volume[93191]: INFO cinder.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Service 3 cleanup completed. Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG cinder.service [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Creating RPC server for service cinder-volume {{(pid=93191) start /opt/stack/cinder/cinder/service.py:231}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG cinder.service [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93191) start /opt/stack/cinder/cinder/service.py:237}} Jun 27 04:27:32 devstack cinder-volume[93191]: INFO cinder.volume.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:32 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:32 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:32 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:33 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:33 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.665s {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:33 devstack cinder-volume[93191]: INFO cinder.volume.manager [None req-e994ae4f-2195-43d1-b864-fc93132caee9 None None] Driver post RPC initialization completed successfully. Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG cinder.volume.drivers.quobyte [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:37 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:37 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:37 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG oslo_concurrency.processutils [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.626s {{(pid=93191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:37 devstack cinder-volume[93191]: DEBUG cinder.manager [None req-800046b0-e58e-49f3-afbd-3b20eb68ab74 None None] Notifying Schedulers of capabilities ... {{(pid=93191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:27:39 devstack cinder-volume[92972]: DEBUG dbcounter [-] [92972] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:27:40 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Caught SIGTERM, stopping children Jun 27 04:27:40 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Acquiring lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:27:40 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Acquired lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:27:40 devstack cinder-volume[92972]: DEBUG oslo_concurrency.lockutils [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Releasing lock "singleton_lock" {{(pid=92972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:27:40 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Stop services. {{(pid=92972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 27 04:27:40 devstack cinder-volume[92972]: DEBUG oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Killing children. {{(pid=92972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 27 04:27:40 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Waiting on 1 children to exit Jun 27 04:27:42 devstack cinder-volume[93191]: DEBUG dbcounter [-] [93191] Writing DB stats cinder:SELECT=4 {{(pid=93191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:27:43 devstack cinder-volume[93191]: DEBUG dbcounter [-] [93191] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:27:45 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Acquiring lock "singleton_lock" {{(pid=93191) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:27:45 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Acquired lock "singleton_lock" {{(pid=93191) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:27:45 devstack cinder-volume[93191]: DEBUG oslo_concurrency.lockutils [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Releasing lock "singleton_lock" {{(pid=93191) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:27:45 devstack cinder-volume[93191]: WARNING amqp [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 04:27:45 devstack cinder-volume[93191]: WARNING amqp [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 27 04:27:45 devstack cinder-volume[92972]: INFO oslo_service.backend._eventlet.service [None req-0d58f4e4-6b1e-4bfb-a0f7-d2a9fdb86387 None None] Child 93191 exited with status 0 Jun 27 04:27:46 devstack cinder-volume[93483]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 27 04:27:46 devstack cinder-volume[93483]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 04:27:46 devstack cinder-volume[93483]: we strongly recommend against using it for new projects. Jun 27 04:27:46 devstack cinder-volume[93483]: If you are already using Eventlet, we recommend migrating to a different Jun 27 04:27:46 devstack cinder-volume[93483]: framework. For more detail see Jun 27 04:27:46 devstack cinder-volume[93483]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 04:27:46 devstack cinder-volume[93483]: import eventlet # noqa Jun 27 04:27:48 devstack cinder-volume[93483]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 27 04:27:48 devstack cinder-volume[93483]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 27 04:27:48 devstack cinder-volume[93483]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 27 04:27:49 devstack cinder-volume[93483]: INFO dbcounter [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Registered counter for database cinder Jun 27 04:27:49 devstack cinder-volume[93483]: DEBUG oslo_db.sqlalchemy.engines [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:49 devstack cinder-volume[93483]: DEBUG dbcounter [-] [93483] Writer thread running {{(pid=93483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 04:27:49 devstack cinder-volume[93483]: INFO cinder.rpc [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 27 04:27:49 devstack cinder-volume[93483]: INFO cinder.rpc [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 27 04:27:49 devstack cinder-volume[93483]: DEBUG oslo_db.sqlalchemy.engines [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:49 devstack cinder-volume[93483]: INFO cinder.volume.manager [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Determined volume DB was empty at startup. Jun 27 04:27:49 devstack cinder-volume[93483]: DEBUG cinder.volume.manager [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93483) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Jun 27 04:27:50 devstack cinder-volume[93483]: WARNING stevedore.named [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 27 04:27:50 devstack cinder-volume[93483]: WARNING castellan.key_manager [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:27:50 devstack cinder-volume[93483]: WARNING cinder.keymgr.conf_key_mgr [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 27 04:27:50 devstack cinder-volume[93483]: INFO cinder.volume.manager [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_db.sqlalchemy.engines [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:50 devstack cinder-volume[93483]: INFO oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Starting 1 workers Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Started child 93772 {{(pid=93483) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Full set of CONF: {{(pid=93483) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] ******************************************************************************** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Configuration options gathered from: {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] ================================================================================ {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] allow_availability_zone_fallback = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] allow_compression_on_image_upload = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] allowed_direct_url_schemes = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93772]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.1) Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] api_rate_limit = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] auth_strategy = keystone {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_availability_zone = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_host = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_stats_polling_interval = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backup_api_class = cinder.backup.api.API {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backup_name_template = backup-%s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backup_use_same_host = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backup_use_temp_snapshot = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] chap_password = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] chap_username = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_internal_tenant_project_id = a27c50f98afb4d85aeb8af07e076a322 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_internal_tenant_user_id = c9e4e4d62551441dbe0b87c53054a768 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cluster = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] compression_format = gzip {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] compute_api_class = cinder.compute.nova.API {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] config_dir = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] config_source = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] control_exchange = openstack {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] debug = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] default_availability_zone = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] default_group_type = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] default_volume_type = QuobyteHD {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] disk_geometry = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] driver_client_cert = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] driver_client_cert_key = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] driver_data_namespace = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] driver_ssl_cert_path = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] driver_ssl_cert_verify = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] driver_use_ssl = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] enable_new_services = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] enable_unsupported_driver = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] enabled_backends = ['QuobyteHD'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] enforce_multipath_for_image_xfer = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] filter_function = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_api_insecure = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_api_ssl_compression = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_ca_certificates_file = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_catalog_info = image:glance:publicURL {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_num_retries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance_request_timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] goodness_function = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] graceful_shutdown_timeout = 5 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] group_api_class = cinder.group.api.API {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] host = devstack {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_compress_on_upload = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_conversion_address_space_limit = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_conversion_cpu_limit = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_conversion_disable = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_upload_use_cinder_backend = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_upload_use_internal_tenant = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_volume_cache_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_volume_cache_max_count = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] image_volume_cache_max_size_gb = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] init_host_max_objects_retrieval = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] instance_format = [instance: %(uuid)s] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] iscsi_target_flags = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] iscsi_write_cache = on {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] iser_helper = tgtadm {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] iser_ip_address = 192.168.122.7 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] iser_port = 3260 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_color = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_config_append = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_dir = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_file = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_options = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_rotate_interval = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_rotate_interval_type = days {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] log_rotation_type = none {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] max_age = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] max_logfile_count = 30 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] max_logfile_size_mb = 200 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] max_over_subscription_ratio = 20.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] message_reap_interval = 86400 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] message_ttl = 2592000 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] migration_create_volume_timeout_secs = 300 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] monkey_patch = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] monkey_patch_modules = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] my_ip = 192.168.122.7 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] no_snapshot_gb_quota = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] num_iser_scan_tries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] num_shell_tries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] num_volume_device_scan_tries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] nvmeof_conn_info_version = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] nvmet_ns_id = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] nvmet_port_id = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Starting volume driver QuobyteDriver (1.1.14) Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_max_limit = 1000 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_volume_ext_list = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_volume_listen = 0.0.0.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93772) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_volume_listen_port = 8776 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_volume_use_ssl = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] osapi_volume_workers = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] per_volume_size_limit = -1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] periodic_fuzzy_delay = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] periodic_interval = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] project_id_regex = [0-9a-f\-]+ {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] public_endpoint = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] publish_errors = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_backup_gigabytes = 1000 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_backups = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_gigabytes = 1000 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_groups = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_snapshots = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] quota_volumes = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] rate_limit_burst = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] rate_limit_except_level = CRITICAL {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] rate_limit_interval = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] reinit_driver_count = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] replication_device = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] report_discard_supported = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] report_interval = 120 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] reservation_clean_interval = 86400 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] reservation_expire = 86400 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] reserved_image_namespaces = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] reserved_percentage = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] rpc_response_timeout = 120 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] run_external_periodic_tasks = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] scst_target_driver = iscsi {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] scst_target_iqn_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_down_time = 720 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] shell_completion = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] snapshot_name_template = snapshot-%s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] split_loggers = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] state_path = /opt/stack/data/cinder {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] storage_availability_zone = nova {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] storage_protocol = iSCSI {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] syslog_log_facility = LOG_USER {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] target_helper = lioadm {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] target_ip_address = 192.168.122.7 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] target_port = 3260 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] target_protocol = iscsi {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] target_secondary_ip_addresses = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] trace_flags = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] transfer_api_class = cinder.transfer.api.API {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] transport_url = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] until_refresh = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_chap_auth = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_default_quota_class = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_journal = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_json = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_multipath_for_image_xfer = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_stderr = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] use_syslog = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] verify_glance_signatures = enabled {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_api_class = cinder.volume.api.API {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_backend_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_clear = zero {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_clear_ionice = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_clear_size = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_copy_bps_limit = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_dd_blocksize = 1M {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_name_template = volume-%s {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_service_inithost_offload = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volume_usage_audit_period = month {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] zoning_mode = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_concurrency.disable_process_locking = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.auth_section = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.auth_type = password {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.auth_version = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.cache = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.delay_auth_decision = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.http_connect_timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.include_service_catalog = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.insecure = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.interface = public {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_password = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcache_username = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.region_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.service_token_roles_required = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.service_type = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.token_cache_time = 300 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.backend = dogpile.cache.null {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.backend_argument = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.backend_expiration_time = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.config_prefix = cache.oslo {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.debug_cache_backend = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.enable_retry_client = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.enable_socket_keepalive = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.expiration_time = 600 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.hashclient_retry_attempts = 2 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_dead_retry = 300 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_pool_maxsize = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_sasl_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.password = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.proxies = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.redis_db = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.redis_sentinel_service_name = mymaster {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.redis_server = localhost:6379 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.retry_attempts = 2 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.retry_delay = 0.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.socket_keepalive_count = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.socket_keepalive_idle = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.socket_keepalive_interval = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.socket_timeout = 1.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.tls_allowed_ciphers = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.tls_cafile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.tls_certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.tls_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.tls_keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cache.username = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] coordination.backend_url = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.asyncio_connection = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.asyncio_slave_connection = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.backend = sqlalchemy {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.connection = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.connection_debug = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.connection_parameters = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.connection_recycle_time = 3600 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.connection_trace = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.db_inc_retry_interval = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.db_max_retries = 20 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.db_max_retry_interval = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.db_retry_interval = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.max_overflow = 50 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.max_pool_size = 5 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.max_retries = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.mysql_wsrep_sync_wait = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.pool_timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.retry_interval = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.slave_connection = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.sqlite_synchronous = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.synchronous_reader = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] database.use_db_reconnect = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.connection_string = messaging:// {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.es_doc_type = notification {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.es_scroll_size = 10000 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.es_scroll_time = 2m {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.filter_error_trace = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.hmac_keys = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.sentinel_service_name = mymaster {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.socket_timeout = 0.1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.trace_requests = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler.trace_sqlalchemy = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler_jaeger.process_tags = {} {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler_jaeger.service_name_prefix = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] profiler_otlp.service_name_prefix = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.enforce_new_defaults = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: WARNING oslo_config.cfg [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.enforce_scope = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.policy_default_rule = default {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.policy_file = policy.yaml {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_policy.remote_timeout = 60.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.group = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.helper_command = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] privsep_osbrick.user = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.group = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.helper_command = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] cinder_sys_admin.user = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93772) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 27 04:27:50 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.auth_section = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.auth_type = password {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.cafile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.collect_timing = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.insecure = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.send_service_user_token = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.split_loggers = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] service_user.timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.auth_section = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.auth_type = password {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.collect_timing = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.insecure = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Running cmd (subprocess): mount.quobyte {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.region_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.split_loggers = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] glance.timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.backend_availability_zone = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.chap_password = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.chap_username = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.disk_geometry = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.driver_client_cert = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.driver_client_cert_key = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.driver_data_namespace = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.driver_use_ssl = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.enable_unsupported_driver = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.extra_capabilities = {} {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.filter_function = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.goodness_function = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.iscsi_target_flags = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.iscsi_write_cache = on {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.iser_helper = tgtadm {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.iser_port = 3260 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_host = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_login = admin {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_mount_options = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_password = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_private_key = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_share_path = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_ssh_port = 22 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.num_shell_tries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.nvmet_port_id = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_client_cfg = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.quobyte_volume_url = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.replication_device = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.report_discard_supported = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.reserved_percentage = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.scst_target_driver = iscsi {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.scst_target_iqn_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.storage_protocol = iSCSI {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.target_helper = tgtadm {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.target_port = 3260 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.target_protocol = iscsi {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.trace_flags = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.unique_fqdn_network = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.use_chap_auth = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_backend_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_clear = zero {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_clear_ionice = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_clear_size = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_reports.file_event_handler = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_reports.log_dir = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.backend_availability_zone = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.backend_host = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.chap_password = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.chap_username = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.chiscsi_conf = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.disk_geometry = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.driver_client_cert = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.driver_client_cert_key = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.driver_data_namespace = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.driver_use_ssl = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.extra_capabilities = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.filter_function = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.goodness_function = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.iscsi_target_flags = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.iscsi_write_cache = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.iser_helper = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.iser_ip_address = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.iser_port = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.iser_target_prefix = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_host = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_login = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_mount_options = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_password = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_private_key = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_share_path = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_ssh_port = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.num_shell_tries = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nvmet_ns_id = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.nvmet_port_id = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.replication_device = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.report_discard_supported = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.reserved_percentage = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.scst_target_driver = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.storage_protocol = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.target_helper = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.target_ip_address = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.target_port = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.target_prefix = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.target_protocol = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.trace_flags = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.unique_fqdn_network = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.use_chap_auth = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_clear = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_clear_ionice = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_clear_size = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] QuobyteHD.volumes_dir = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack quobyte-client[93785]: Reading configuration file: /etc/quobyte/client.cfg Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack quobyte-client[93785]: Invalid parameters found, error: missing mount point. Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack quobyte-client[93785]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.ssl_version = {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_notifications.driver = [] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack quobyte-client[93785]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_notifications.retry = -1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] oslo_messaging_notifications.transport_url = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] key_manager.fixed_key = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.barbican_api_version = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.barbican_endpoint = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.barbican_endpoint_type = public {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.barbican_region_name = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.cafile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.collect_timing = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.insecure = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.number_of_retries = 60 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.retry_delay = 1 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.send_service_user_token = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.split_loggers = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.verify_ssl = True {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican.verify_ssl_path = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.auth_section = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.auth_type = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.cafile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.certfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.collect_timing = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.insecure = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.keyfile = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.split_loggers = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] barbican_service_user.timeout = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.approle_role_id = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.approle_secret_id = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.kv_mountpoint = secret {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.kv_path = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.kv_version = 2 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.namespace = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.root_token_id = **** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.ssl_ca_crt_file = None {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.timeout = 60.0 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.use_ssl = False {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 27 04:27:50 devstack cinder-volume[93483]: DEBUG oslo_service.backend._eventlet.service [None req-41b6eb1a-f3d7-4398-98bf-f5dd919a6add None None] ******************************************************************************** {{(pid=93483) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 27 04:27:50 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:50 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:51 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.635s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:51 devstack cinder-volume[93772]: INFO cinder.volume.driver [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Driver hasn't implemented _init_vendor_properties() Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.volume.driver [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7402648925781, 'free_capacity_gb': 1775.7402648925781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93772) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93772) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writer thread running {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.db.sqlalchemy.api [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Building query based on filter {{(pid=93772) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93772) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:51 devstack cinder-volume[93772]: INFO cinder.keymgr.migration [None req-5caeb5ea-5aab-418b-9e4f-b0a2bcbc6dd0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 27 04:27:51 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:51 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:51 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.630s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:27:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Driver initialization completed successfully. Jun 27 04:27:51 devstack cinder-volume[93772]: INFO cinder.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Initiating service 3 cleanup Jun 27 04:27:51 devstack cinder-volume[93772]: INFO cinder.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Service 3 cleanup completed. Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.service [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Creating RPC server for service cinder-volume {{(pid=93772) start /opt/stack/cinder/cinder/service.py:231}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.service [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93772) start /opt/stack/cinder/cinder/service.py:237}} Jun 27 04:27:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:27:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:27:51 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:27:51 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:27:52 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Jun 27 04:27:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.633s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:27:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dc8ce44f-853e-4bfb-bf08-920ead923c3c None None] Driver post RPC initialization completed successfully. Jun 27 04:28:00 devstack cinder-volume[93483]: DEBUG dbcounter [-] [93483] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:28:01 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=2 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:28:02 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Flow 'volume_create_manager' (2a7370fb-1514-4a53-8e76-ac0f0fac8092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd1c43a-24e5-4008-9e78-1de16881feae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd1c43a-24e5-4008-9e78-1de16881feae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1592733196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72e14f7-7f6d-41dc-9ed4-348d4087b4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3ae9c2bb2446af9f3e3886b422f19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:28:49Z,use_quota=True,user_id='d804690223194e818247055779b47510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c97e73-5ca6-4ae7-b484-c594586f68e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c97e73-5ca6-4ae7-b484-c594586f68e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d4a4c4-9b4c-45f2-ac31-1ad4b10b587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d4a4c4-9b4c-45f2-ac31-1ad4b10b587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72e14f7-7f6d-41dc-9ed4-348d4087b4a5', 'volume_name': 'volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d3d852-a174-4113-8431-6faaddc13636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1d3d852-a174-4113-8431-6faaddc13636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be9eab8-fa39-468c-9db6-71064a09b81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:28:48 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Volume b72e14f7-7f6d-41dc-9ed4-348d4087b4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5', 'volume_size': 1} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1592733196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72e14f7-7f6d-41dc-9ed4-348d4087b4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3ae9c2bb2446af9f3e3886b422f19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:28:49Z,use_quota=True,user_id='d804690223194e818247055779b47510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Creating volume b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:28:48 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:28:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:28:48 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 1073741824 Jun 27 04:28:48 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:28:49 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jun 27 04:28:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 1073741824" returned: 0 in 1.082s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:28:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:28:50 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 Jun 27 04:28:50 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:28:50 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Jun 27 04:28:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" returned: 0 in 1.007s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:28:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:28:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:28:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be9eab8-fa39-468c-9db6-71064a09b81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:28:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf6baca-a02c-42ea-8df8-ddf2428f5705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:28:51 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Volume volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 (b72e14f7-7f6d-41dc-9ed4-348d4087b4a5): created successfully Jun 27 04:28:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf6baca-a02c-42ea-8df8-ddf2428f5705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:28:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Flow 'volume_create_manager' (2a7370fb-1514-4a53-8e76-ac0f0fac8092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:28:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-672bf2be-f419-49ac-a339-26c14393f408 tempest-TaggedAttachmentsTest-1669511757 None] Created volume successfully. Jun 27 04:29:00 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:29:01 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:20 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:29:20 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Flow 'volume_create_manager' (fe5a24e2-fec7-44eb-bcb8-68255e662fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1652d0e-ad76-4428-a4af-f44b3310e4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1652d0e-ad76-4428-a4af-f44b3310e4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-120079285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6c32c-5687-4522-8958-2611b2051966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdee556688f439fa969d75afa7b2063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:22Z,use_quota=True,user_id='16a491f8862f40189df38da028a6fec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990fd688-fd89-4094-a989-3afba7d8081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990fd688-fd89-4094-a989-3afba7d8081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b953cd7-8853-4877-8091-da8c5447f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b953cd7-8853-4877-8091-da8c5447f837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a6c32c-5687-4522-8958-2611b2051966', 'volume_name': 'volume-04a6c32c-5687-4522-8958-2611b2051966', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8b1e1d-37fd-40d7-baa4-b68e9fe4d286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8b1e1d-37fd-40d7-baa4-b68e9fe4d286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbf30d7-cf4f-487d-90a5-41ca7aa7a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:21 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Volume 04a6c32c-5687-4522-8958-2611b2051966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a6c32c-5687-4522-8958-2611b2051966', 'volume_size': 1} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-120079285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6c32c-5687-4522-8958-2611b2051966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdee556688f439fa969d75afa7b2063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:22Z,use_quota=True,user_id='16a491f8862f40189df38da028a6fec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Creating volume 04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:29:21 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:21 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 1073741824 Jun 27 04:29:21 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:21 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.346s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:29:22 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 1073741824" returned: 0 in 1.172s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:23 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 Jun 27 04:29:23 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:24 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966" returned: 0 in 1.102s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cbf30d7-cf4f-487d-90a5-41ca7aa7a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a6c32c-5687-4522-8958-2611b2051966', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe38a3b-3370-4b3a-a538-02eb1e0aa0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:24 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Volume volume-04a6c32c-5687-4522-8958-2611b2051966 (04a6c32c-5687-4522-8958-2611b2051966): created successfully Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe38a3b-3370-4b3a-a538-02eb1e0aa0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Flow 'volume_create_manager' (fe5a24e2-fec7-44eb-bcb8-68255e662fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-232a0c0b-90cc-45bb-b77e-beeca0667f23 req-7949c5da-79b9-40ff-bee6-a41a90691a15 tempest-VolumesSnapshotsTestJSON-1768390495 None] Created volume successfully. Jun 27 04:29:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Creating offline snapshot 7cb6578c-3bd4-4c30-bd8f-c4716e87d86f of volume 04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:29:25 devstack cinder-volume[93772]: INFO oslo.privsep.daemon [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprzq6vqp7/privsep.sock'] Jun 27 04:29:25 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprzq6vqp7/privsep.sock Jun 27 04:29:25 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 04:29:26 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: Jun 27 04:29:27 devstack cinder-volume[93772]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 27 04:29:28 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:28 devstack cinder-volume[93772]: INFO oslo.privsep.daemon [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Spawned new privsep daemon via rootwrap Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Accepted privsep connection to /tmp/tmprzq6vqp7/privsep.sock {{(pid=93772) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 27 04:29:28 devstack cinder-volume[93772]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 27 04:29:28 devstack cinder-volume[93772]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 27 04:29:28 devstack cinder-volume[93772]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 27 04:29:28 devstack cinder-volume[93772]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94990 Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f0d571-307d-489a-9e91-74459166cc1f]: (2,) {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0411aae-d21f-496c-8d3e-be4ca0b70e1d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:28 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 Jun 27 04:29:28 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Flow 'volume_create_manager' (69b7d3ed-e4fe-457e-a387-62b6f80e48d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa71853-8f49-4ae2-b62c-4abd3b0f4b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa71853-8f49-4ae2-b62c-4abd3b0f4b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1719802742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1f8efc-98da-47ee-95ac-9c8da6350322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896fe3c2218642f5ae10754692e3114d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:29Z,use_quota=True,user_id='a63f91ffd8d345549bb6abc5f78c2297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0afe671-81bb-4d8e-a0ef-a9255fbae798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0afe671-81bb-4d8e-a0ef-a9255fbae798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645176f9-21be-4394-aebc-acc0638f2e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645176f9-21be-4394-aebc-acc0638f2e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1f8efc-98da-47ee-95ac-9c8da6350322', 'volume_name': 'volume-7c1f8efc-98da-47ee-95ac-9c8da6350322', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2badc143-2c4b-41ca-b544-f4ffedeeba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2badc143-2c4b-41ca-b544-f4ffedeeba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053b5340-a351-4433-893e-d6d3dcf80b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Volume 7c1f8efc-98da-47ee-95ac-9c8da6350322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1f8efc-98da-47ee-95ac-9c8da6350322', 'volume_size': 1} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:29 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966" returned: 0 in 1.349s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:29 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f 1G Jun 27 04:29:29 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:31 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f 1G" returned: 0 in 1.537s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a6c32c-5687-4522-8958-2611b2051966 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:29:31 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a6c32c-5687-4522-8958-2611b2051966 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f Jun 27 04:29:31 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Flow 'volume_create_manager' (d60d23bb-4502-43e5-aec9-d50ead9454cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610d2133-4b29-4256-814f-09bf2b34a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (610d2133-4b29-4256-814f-09bf2b34a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1455269701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc9ba95-f732-4c60-8af6-841a94735487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a8ce6c279647fd936f2229074fd515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:31Z,use_quota=True,user_id='be07b536984d405d81374eb699168563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f00b2b8-85a1-4bcd-bdc8-b4ac6c99fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f00b2b8-85a1-4bcd-bdc8-b4ac6c99fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c17116-cdb4-4c53-beb7-43af5493b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c17116-cdb4-4c53-beb7-43af5493b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc9ba95-f732-4c60-8af6-841a94735487', 'volume_name': 'volume-3fc9ba95-f732-4c60-8af6-841a94735487', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41701575-3024-488a-9927-5bb2e33474ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41701575-3024-488a-9927-5bb2e33474ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cac4ab-f314-4f6a-9ddb-c4886687f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:31 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Volume 3fc9ba95-f732-4c60-8af6-841a94735487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc9ba95-f732-4c60-8af6-841a94735487', 'volume_size': 1} Jun 27 04:29:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:32 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a6c32c-5687-4522-8958-2611b2051966 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" returned: 0 in 1.362s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:32 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f is being set with open permissions: ugo+rw Jun 27 04:29:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:32 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f Jun 27 04:29:32 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:33 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" returned: 0 in 0.841s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:33 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info Jun 27 04:29:33 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:34 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info" returned: 0 in 1.059s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:34 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info is being set with open permissions: ugo+rw Jun 27 04:29:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:34 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info Jun 27 04:29:34 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:35 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.info" returned: 0 in 0.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.926s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.433s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1719802742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1f8efc-98da-47ee-95ac-9c8da6350322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896fe3c2218642f5ae10754692e3114d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:29Z,use_quota=True,user_id='a63f91ffd8d345549bb6abc5f78c2297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Creating volume 7c1f8efc-98da-47ee-95ac-9c8da6350322 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:29:35 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:29:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:35 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 1073741824 Jun 27 04:29:35 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-c4ae1b44-bb7e-4644-8715-94cebcd1cc15 req-c300ceab-0654-427d-917e-4018a90cac8c tempest-VolumesSnapshotsTestJSON-1768390495 None] Create snapshot completed successfully Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "cinder-7cb6578c-3bd4-4c30-bd8f-c4716e87d86f-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-7cb6578c-3bd4-4c30-bd8f-c4716e87d86f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "cinder-quobyte-04a6c32c-5687-4522-8958-2611b2051966" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-quobyte-04a6c32c-5687-4522-8958-2611b2051966" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "cinder-quobyte-7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-quobyte-7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Deleting offline snapshot 7cb6578c-3bd4-4c30-bd8f-c4716e87d86f of volume 04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] snapshot_file for this snap is: volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd83ac0d-95a9-4a4e-9cf3-48c6433ee69b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:36 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f Jun 27 04:29:36 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:37 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 1073741824" returned: 0 in 1.614s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:37 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 Jun 27 04:29:37 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:37 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" returned: 0 in 1.141s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04a6c32c-5687-4522-8958-2611b2051966(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:29:37 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef95830-b249-4e09-8b3d-ff632f86db42]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:37 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 Jun 27 04:29:37 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:38 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322" returned: 0 in 1.155s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] <== create_volume: return (2843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.847s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.831s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1455269701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc9ba95-f732-4c60-8af6-841a94735487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15a8ce6c279647fd936f2229074fd515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:31Z,use_quota=True,user_id='be07b536984d405d81374eb699168563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Creating volume 3fc9ba95-f732-4c60-8af6-841a94735487 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:29:38 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:38 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 1073741824 Jun 27 04:29:38 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053b5340-a351-4433-893e-d6d3dcf80b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1f8efc-98da-47ee-95ac-9c8da6350322', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffae8457-d8dd-483c-8f17-1a030ee3ce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:38 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Volume volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 (7c1f8efc-98da-47ee-95ac-9c8da6350322): created successfully Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffae8457-d8dd-483c-8f17-1a030ee3ce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Flow 'volume_create_manager' (69b7d3ed-e4fe-457e-a387-62b6f80e48d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c78df374-d62b-4c53-b96c-8f057adbb7fb tempest-DeleteServersTestJSON-1389078348 None] Created volume successfully. Jun 27 04:29:38 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966" returned: 0 in 1.356s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:39 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f Jun 27 04:29:39 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:39 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 1073741824" returned: 0 in 1.572s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:39 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 Jun 27 04:29:39 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:40 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" returned: 0 in 1.408s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:40 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f Jun 27 04:29:40 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:40 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487" returned: 0 in 0.891s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] <== create_volume: return (2523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.528s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cac4ab-f314-4f6a-9ddb-c4886687f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc9ba95-f732-4c60-8af6-841a94735487', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4341bde-78e1-434a-b467-0e5e44a039db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:40 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Volume volume-3fc9ba95-f732-4c60-8af6-841a94735487 (3fc9ba95-f732-4c60-8af6-841a94735487): created successfully Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4341bde-78e1-434a-b467-0e5e44a039db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Flow 'volume_create_manager' (d60d23bb-4502-43e5-aec9-d50ead9454cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:40 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d6bcca3a-144e-45ca-a23b-2c7bf5687336 tempest-VolumesAdminNegativeTest-347689010 None] Created volume successfully. Jun 27 04:29:41 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966.7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" returned: 0 in 1.176s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-quobyte-7cb6578c-3bd4-4c30-bd8f-c4716e87d86f" released by "_delete_snapshot" :: held 5.245s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-quobyte-04a6c32c-5687-4522-8958-2611b2051966" released by "delete_snapshot" :: held 5.313s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:41 devstack cinder-volume[93772]: WARNING cinder.quota [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:29:41 devstack cinder-volume[93772]: WARNING cinder.quota [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:29:41 devstack cinder-volume[93772]: DEBUG cinder.quota [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Created reservations ['0e1db69f-4703-4b42-9bd9-cfaac1910d2a', 'b2108aaf-f408-4565-9f92-f3910b2dc324', 'd5ceeec2-9871-475f-a621-efe58a54aae8', 'd8cd244c-e46f-49b6-bc5c-805343247f01'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:29:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Delete snapshot completed successfully. Jun 27 04:29:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-d19c30d0-dfe9-44e2-81e5-094446d04a91 req-4e11cf93-266d-409b-9805-379a582c3eef tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-7cb6578c-3bd4-4c30-bd8f-c4716e87d86f-delete_snapshot" released by "delete_snapshot" :: held 5.695s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Acquiring lock "cinder-3fc9ba95-f732-4c60-8af6-841a94735487-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Lock "cinder-3fc9ba95-f732-4c60-8af6-841a94735487-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "cinder-04a6c32c-5687-4522-8958-2611b2051966-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-04a6c32c-5687-4522-8958-2611b2051966-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Acquiring lock "cinder-quobyte-3fc9ba95-f732-4c60-8af6-841a94735487" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Lock "cinder-quobyte-3fc9ba95-f732-4c60-8af6-841a94735487" acquired by "delete_volume" :: waited 0.044s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[81315e3e-ea80-48e5-a713-0b04e029b9a3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "cinder-quobyte-04a6c32c-5687-4522-8958-2611b2051966" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-quobyte-04a6c32c-5687-4522-8958-2611b2051966" acquired by "delete_volume" :: waited 0.051s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ff1067-4ef2-4006-b54b-f4ca14e29f83]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:42 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 Jun 27 04:29:42 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:43 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 Jun 27 04:29:43 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:44 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487" returned: 0 in 1.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:44 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487 Jun 27 04:29:44 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:44 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966" returned: 0 in 1.746s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:44 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966 Jun 27 04:29:44 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:45 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3fc9ba95-f732-4c60-8af6-841a94735487" returned: 0 in 1.551s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Lock "cinder-quobyte-3fc9ba95-f732-4c60-8af6-841a94735487" released by "delete_volume" :: held 3.431s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:46 devstack cinder-volume[93772]: WARNING cinder.quota [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Created reservations ['4952ad70-a94f-43aa-9fbd-bef7d0676af6', '94b06ea0-a065-4a05-a418-aa11a3b0de02', 'e98c24e5-2a9c-4332-8b83-4f3ab564b2c1', 'c7af32fb-f080-4b0a-9a3c-cb20e01e9748'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:29:46 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04a6c32c-5687-4522-8958-2611b2051966" returned: 0 in 1.665s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-quobyte-04a6c32c-5687-4522-8958-2611b2051966" released by "delete_volume" :: held 3.541s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:46 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:29:46 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.quota [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Created reservations ['3dc9055f-d945-447f-a0fd-0b30e6556759', '3d919efa-8a9b-4694-bbf5-d52a5547753b', '38f6d9b9-5f91-4582-bc95-fd1954bf7858', 'aa769100-7d65-490e-91da-b1be3394439b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:46 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:29:46 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:47 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.169s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:29:47 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Deleted volume successfully. Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-02c051ea-f409-4287-a1f9-ff579445204e tempest-VolumesAdminNegativeTest-347689010 None] Lock "cinder-3fc9ba95-f732-4c60-8af6-841a94735487-delete_volume" released by "delete_volume" :: held 5.285s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:47 devstack cinder-volume[93772]: WARNING py.warnings [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 27 04:29:47 devstack cinder-volume[93772]: .first() Jun 27 04:29:47 devstack cinder-volume[93772]: Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[89664749-24ba-44a3-b294-fbde8f7879fc]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:29:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:48 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 Jun 27 04:29:48 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:48 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.640s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:48 devstack cinder-volume[93772]: DEBUG cinder.manager [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:29:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Deleted volume successfully. Jun 27 04:29:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-fc6eca3e-8be2-46e0-a01d-7b404ef25329 req-e8fcd2be-e862-4ce6-8230-5e8b1c8f66f6 tempest-VolumesSnapshotsTestJSON-1768390495 None] Lock "cinder-04a6c32c-5687-4522-8958-2611b2051966-delete_volume" released by "delete_volume" :: held 5.905s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:29:49 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322" returned: 0 in 1.460s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.518s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-7c1f8efc-98da-47ee-95ac-9c8da6350322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94ab9f51-e323-413b-a6d0-fb7f03fcc870', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:29:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-e6ce5565-67a1-40b5-bb33-cfae817e5402 req-a5d74f3d-3143-4870-9e5c-d1a06d38d5b8 tempest-DeleteServersTestJSON-1389078348 None] attachment_update completed successfully. Jun 27 04:29:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-de1deaf1-530c-4691-9aee-d65b946e0651 tempest-GroupSnapshotsV319Test-478674911 None] Group tempest-GroupSnapshotsV319Test-Group-1706055899: creating Jun 27 04:29:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-de1deaf1-530c-4691-9aee-d65b946e0651 tempest-GroupSnapshotsV319Test-478674911 None] Group tempest-GroupSnapshotsV319Test-Group-1706055899: created successfully Jun 27 04:29:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-de1deaf1-530c-4691-9aee-d65b946e0651 tempest-GroupSnapshotsV319Test-478674911 None] Create group completed successfully. Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Flow 'volume_create_manager' (765e9548-ed10-406e-a4c2-9e39caba391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045041f0-18b6-4e27-b37e-868ebb52de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045041f0-18b6-4e27-b37e-868ebb52de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987257709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abcaea26-3a67-4c10-8ae2-93808d321dd8,host='devstack@QuobyteHD#QuobyteHD',id=48a2ded3-78fd-4527-9b39-12999e181da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77493b436a4447fa7a2d4d8114d3f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:56Z,use_quota=True,user_id='279a362bd7d74052a142f19c712a8e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f29be1d-daaa-4c4d-ae27-e79de4518068),volume_type_id=3f29be1d-daaa-4c4d-ae27-e79de4518068)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946851ac-dfe4-41c4-94a1-07633db26edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946851ac-dfe4-41c4-94a1-07633db26edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9354e7b3-04b9-418e-ab14-5d20368e64b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9354e7b3-04b9-418e-ab14-5d20368e64b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a2ded3-78fd-4527-9b39-12999e181da8', 'volume_name': 'volume-48a2ded3-78fd-4527-9b39-12999e181da8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d542b81-6dd9-44c1-ad7d-be9002c74d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d542b81-6dd9-44c1-ad7d-be9002c74d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483d7dd5-0f7b-4b8b-9a9c-1fb528c2e58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Volume 48a2ded3-78fd-4527-9b39-12999e181da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a2ded3-78fd-4527-9b39-12999e181da8', 'volume_size': 1} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=abcaea26-3a67-4c10-8ae2-93808d321dd8,created_at=2026-06-27T02:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987257709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=abcaea26-3a67-4c10-8ae2-93808d321dd8,host='devstack@QuobyteHD#QuobyteHD',id=48a2ded3-78fd-4527-9b39-12999e181da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77493b436a4447fa7a2d4d8114d3f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:29:56Z,use_quota=True,user_id='279a362bd7d74052a142f19c712a8e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f29be1d-daaa-4c4d-ae27-e79de4518068),volume_type_id=3f29be1d-daaa-4c4d-ae27-e79de4518068)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Creating volume 48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:29:56 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:29:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:56 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 1073741824 Jun 27 04:29:56 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:57 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 1073741824" returned: 0 in 1.444s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:29:57 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 Jun 27 04:29:57 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:29:58 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8" returned: 0 in 0.727s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483d7dd5-0f7b-4b8b-9a9c-1fb528c2e58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a2ded3-78fd-4527-9b39-12999e181da8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb421f81-1020-4d60-acc4-cf79f3d04a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:29:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Volume volume-48a2ded3-78fd-4527-9b39-12999e181da8 (48a2ded3-78fd-4527-9b39-12999e181da8): created successfully Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb421f81-1020-4d60-acc4-cf79f3d04a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:29:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Flow 'volume_create_manager' (765e9548-ed10-406e-a4c2-9e39caba391a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:29:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-040ad044-4231-4407-89a7-5b3d3cd4024f tempest-GroupSnapshotsV319Test-478674911 None] Created volume successfully. Jun 27 04:29:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-1d1c85ed-1578-49f9-b3bb-de1df7532579 req-4e968ffe-d858-4212-9bcb-5b990d12cb09 tempest-DeleteServersTestJSON-1389078348 None] Terminate volume connection completed successfully. Jun 27 04:29:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-1d1c85ed-1578-49f9-b3bb-de1df7532579 req-4e968ffe-d858-4212-9bcb-5b990d12cb09 tempest-DeleteServersTestJSON-1389078348 None] Deleting attachment 94ab9f51-e323-413b-a6d0-fb7f03fcc870. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:30:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] GroupSnapshot 64710d97-ff10-4ea3-9b64-14a464f5916a: creating. Jun 27 04:30:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Group snapshot 64710d97-ff10-4ea3-9b64-14a464f5916a: creating. {{(pid=93772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 04:30:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:30:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:30:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Creating offline snapshot 24aff46f-ed49-4d83-989c-8756ca2abbb6 of volume 48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:30:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a94dd5-3907-47ab-8358-f172dd38c7d9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:30:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:00 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 Jun 27 04:30:00 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:01 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8" returned: 0 in 0.870s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:01 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 1G Jun 27 04:30:01 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:02 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 1G" returned: 0 in 1.005s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a2ded3-78fd-4527-9b39-12999e181da8 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:02 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a2ded3-78fd-4527-9b39-12999e181da8 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 Jun 27 04:30:02 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:02 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48a2ded3-78fd-4527-9b39-12999e181da8 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6" returned: 0 in 0.829s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:02 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:30:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:02 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 Jun 27 04:30:02 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Acquiring lock "cinder-7c1f8efc-98da-47ee-95ac-9c8da6350322-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Lock "cinder-7c1f8efc-98da-47ee-95ac-9c8da6350322-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:30:03 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6" returned: 0 in 0.768s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Acquiring lock "cinder-quobyte-7c1f8efc-98da-47ee-95ac-9c8da6350322" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Lock "cinder-quobyte-7c1f8efc-98da-47ee-95ac-9c8da6350322" acquired by "delete_volume" :: waited 0.046s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:30:03 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info Jun 27 04:30:03 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3deb6c-0008-4907-b1fd-104f8bf60479]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:30:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:03 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 Jun 27 04:30:03 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:04 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info" returned: 0 in 0.701s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:04 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:30:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:04 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info Jun 27 04:30:04 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:04 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322" returned: 0 in 0.913s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:04 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322 Jun 27 04:30:04 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:05 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.info" returned: 0 in 0.679s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.953s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:30:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b8bb05ab-1cb0-4a22-9470-b90c5a861bbf tempest-GroupSnapshotsV319Test-478674911 None] group_snapshot 64710d97-ff10-4ea3-9b64-14a464f5916a: created successfully Jun 27 04:30:05 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7c1f8efc-98da-47ee-95ac-9c8da6350322" returned: 0 in 0.736s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Lock "cinder-quobyte-7c1f8efc-98da-47ee-95ac-9c8da6350322" released by "delete_volume" :: held 1.709s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Created reservations ['4269c49a-2ff4-452c-9abe-cb54c9951f40', '7bf50a6d-1eb9-4340-82fc-4de876b869c6', '0f4216b9-57bb-460d-b108-530a16c38b19', '7267c5b9-4bd0-4557-a3e9-da8cb75e9aad'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:30:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:05 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:30:05 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] group_snapshot 64710d97-ff10-4ea3-9b64-14a464f5916a: deleting Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] group_snapshot 64710d97-ff10-4ea3-9b64-14a464f5916a: deleting {{(pid=93772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "cinder-quobyte-48a2ded3-78fd-4527-9b39-12999e181da8" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Lock "cinder-quobyte-48a2ded3-78fd-4527-9b39-12999e181da8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "cinder-quobyte-24aff46f-ed49-4d83-989c-8756ca2abbb6" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Lock "cinder-quobyte-24aff46f-ed49-4d83-989c-8756ca2abbb6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Deleting offline snapshot 24aff46f-ed49-4d83-989c-8756ca2abbb6 of volume 48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] snapshot_file for this snap is: volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[649bf84b-7a9a-4c35-868b-1a16efd01d38]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:06 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 Jun 27 04:30:06 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:06 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.024s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:30:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Deleted volume successfully. Jun 27 04:30:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b22cf6ba-4dbb-4aa0-85a9-3e95055344cd tempest-DeleteServersTestJSON-1389078348 None] Lock "cinder-7c1f8efc-98da-47ee-95ac-9c8da6350322-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:30:07 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6" returned: 0 in 0.968s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48a2ded3-78fd-4527-9b39-12999e181da8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:30:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8d0ef-39b6-4ab2-adae-7ab5376b7617]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:30:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:07 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 Jun 27 04:30:07 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:08 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8" returned: 0 in 0.971s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:08 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 Jun 27 04:30:08 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:09 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6" returned: 0 in 1.130s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:09 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6 Jun 27 04:30:09 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:10 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8.24aff46f-ed49-4d83-989c-8756ca2abbb6" returned: 0 in 1.066s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Lock "cinder-quobyte-24aff46f-ed49-4d83-989c-8756ca2abbb6" released by "_delete_snapshot" :: held 4.266s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:30:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Lock "cinder-quobyte-48a2ded3-78fd-4527-9b39-12999e181da8" released by "delete_snapshot" :: held 4.303s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:30:10 devstack cinder-volume[93772]: WARNING cinder.quota [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-687833135 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-687833135, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:30:10 devstack cinder-volume[93772]: WARNING cinder.quota [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-687833135 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-687833135, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:30:10 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] Created reservations ['db1cc4c8-017f-41d0-a1b6-0b8275fb9c68', 'a71bbe45-045a-4be6-a524-2876016ab89a', '36507d30-7d4a-4092-9c55-1e251cea94e6', '5693e53e-0125-4fbf-8643-a04e158e42d6'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:30:10 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5ac6d1b5-c8c4-4e94-a65a-c1306496d76c tempest-GroupSnapshotsV319Test-478674911 None] group_snapshot 64710d97-ff10-4ea3-9b64-14a464f5916a: deleted successfully Jun 27 04:30:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "cinder-quobyte-48a2ded3-78fd-4527-9b39-12999e181da8" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:30:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Lock "cinder-quobyte-48a2ded3-78fd-4527-9b39-12999e181da8" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:30:12 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d58cdd-71c0-4399-9757-1a3fe0d9fcd6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:30:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:12 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 Jun 27 04:30:12 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:13 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8" returned: 0 in 1.074s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:13 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8 Jun 27 04:30:13 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:14 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-48a2ded3-78fd-4527-9b39-12999e181da8" returned: 0 in 0.806s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Lock "cinder-quobyte-48a2ded3-78fd-4527-9b39-12999e181da8" released by "delete_volume" :: held 1.990s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Created reservations ['f2bbd5d3-01b3-423d-bb60-69000c0c6f50'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:30:14 devstack cinder-volume[93772]: WARNING cinder.quota [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-687833135 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-687833135, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Created reservations ['3f20c3cc-4dc8-4b32-8d15-1272a380a9cb', '4e2cfbb5-3156-47be-810d-662237d342c6', '7ff46f84-e02b-41aa-beaf-a9b45b7ba1c8', '5c6f21d2-c48e-458c-a703-ed890e728c3c'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:30:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:14 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:30:14 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:15 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.981s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:15 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:30:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7f76ea0d-3cc5-4e14-aa11-14fba04eb8e4 tempest-GroupSnapshotsV319Test-478674911 None] Delete group completed successfully. Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:30:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:20 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:30:20 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:21 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.864s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:30:24 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=60,cinder:SELECT=60,cinder:DELETE=5,cinder:INSERT=18 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:30:24 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=65,cinder:INSERT=13,cinder:UPDATE=70,cinder:DELETE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:30:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-133ba426-e214-446b-b493-82a6c7ebb6a6 tempest-GroupsV320Test-14979118 None] Group tempest-GroupsV320Test-Group-2142132681: creating Jun 27 04:30:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-133ba426-e214-446b-b493-82a6c7ebb6a6 tempest-GroupsV320Test-14979118 None] Group tempest-GroupsV320Test-Group-2142132681: created successfully Jun 27 04:30:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-133ba426-e214-446b-b493-82a6c7ebb6a6 tempest-GroupsV320Test-14979118 None] Create group completed successfully. Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Created reservations ['c27aba1a-97f3-4f1f-8ab6-a8d6b6599b8c'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:30:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:34 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:30:34 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:35 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.858s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:35 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:30:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c564e74d-60c9-4f7b-bca7-cd6f84bf9e19 tempest-GroupsV320Test-14979118 None] Delete group completed successfully. Jun 27 04:30:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:30:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:30:38 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f89eb9-0c52-4e86-86cf-5960412a08d2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:30:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:30:38 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 Jun 27 04:30:38 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:30:39 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jun 27 04:30:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" returned: 0 in 1.210s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:30:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.234s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:30:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd12cfb15-fa58-4ee5-a7d7-a639ccdf3716', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:30:39 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-994c76d6-7da6-499a-96f6-ceb0e109e9ce req-e05460c7-10f4-481f-bbfa-754300515cd8 tempest-TaggedAttachmentsTest-1669511757 None] attachment_update completed successfully. Jun 27 04:30:47 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-e7d2791a-b911-41b6-bb44-5bdcbc4d7b54 req-f94b3da7-e3f6-4057-8c2d-d8b8541dfff3 tempest-TaggedAttachmentsTest-1669511757 None] Terminate volume connection completed successfully. Jun 27 04:30:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-e7d2791a-b911-41b6-bb44-5bdcbc4d7b54 req-f94b3da7-e3f6-4057-8c2d-d8b8541dfff3 tempest-TaggedAttachmentsTest-1669511757 None] Deleting attachment d12cfb15-fa58-4ee5-a7d7-a639ccdf3716. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:30:49 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:30:57 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:31:12 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:31:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Flow 'volume_create_manager' (e54e8ac4-e94a-4268-83b7-848a1cd30fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd62e8c-ed76-477d-8c1a-aa57590d52c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd62e8c-ed76-477d-8c1a-aa57590d52c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1485235116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c5aafd-b804-4b60-ad65-c7fc041da5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92658f0829284d3ab6e6753cfc98b4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:13Z,use_quota=True,user_id='cc58b84feb054784a71678478f125aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0605493a-36c8-44a6-9ab6-48ffdbc824cf),volume_type_id=0605493a-36c8-44a6-9ab6-48ffdbc824cf)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a634f9b4-531c-44a7-9e3c-ab2c385e68b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a634f9b4-531c-44a7-9e3c-ab2c385e68b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54af737-9750-491a-95b3-7bbfc8ca9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54af737-9750-491a-95b3-7bbfc8ca9677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c5aafd-b804-4b60-ad65-c7fc041da5f9', 'volume_name': 'volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35a7ff4-d685-4086-b527-b4b751189fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35a7ff4-d685-4086-b527-b4b751189fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38ac38e-b14e-4d70-82ae-006029724452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:13 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Volume 65c5aafd-b804-4b60-ad65-c7fc041da5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9', 'volume_size': 1} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1485235116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c5aafd-b804-4b60-ad65-c7fc041da5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92658f0829284d3ab6e6753cfc98b4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:13Z,use_quota=True,user_id='cc58b84feb054784a71678478f125aaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0605493a-36c8-44a6-9ab6-48ffdbc824cf),volume_type_id=0605493a-36c8-44a6-9ab6-48ffdbc824cf)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Creating volume 65c5aafd-b804-4b60-ad65-c7fc041da5f9 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:31:13 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:31:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:13 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 1073741824 Jun 27 04:31:13 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:14 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 1073741824" returned: 0 in 1.556s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:14 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 Jun 27 04:31:14 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Flow 'volume_create_manager' (751cb554-a5c3-4149-b7ca-74c81df5f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac48ead-972f-4b23-9be5-f54293c6669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac48ead-972f-4b23-9be5-f54293c6669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-496026820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22ad755-d538-4250-81c1-e291010d6f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1e131fba2e462e8b53ee4ae758186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:15Z,use_quota=True,user_id='0f9283cb33d24d0789f23b3abae546d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872714f5-289c-4724-af9c-c20a17533aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872714f5-289c-4724-af9c-c20a17533aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b73400-4a52-4c0f-9026-f191ee7ef08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b73400-4a52-4c0f-9026-f191ee7ef08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22ad755-d538-4250-81c1-e291010d6f0a', 'volume_name': 'volume-f22ad755-d538-4250-81c1-e291010d6f0a', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7708fc-de3d-40de-a37c-c0a12f2b3f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7708fc-de3d-40de-a37c-c0a12f2b3f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bea9e1-5da2-4dde-9c78-721ff840ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Volume f22ad755-d538-4250-81c1-e291010d6f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22ad755-d538-4250-81c1-e291010d6f0a', 'volume_size': 1} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:15 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9" returned: 0 in 1.208s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] <== create_volume: return (2824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.827s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-496026820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22ad755-d538-4250-81c1-e291010d6f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1e131fba2e462e8b53ee4ae758186a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:15Z,use_quota=True,user_id='0f9283cb33d24d0789f23b3abae546d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Creating volume f22ad755-d538-4250-81c1-e291010d6f0a {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:31:15 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38ac38e-b14e-4d70-82ae-006029724452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:15 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a 1073741824 Jun 27 04:31:15 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe794fa2-93e1-496e-b292-931682d91391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:16 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Volume volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 (65c5aafd-b804-4b60-ad65-c7fc041da5f9): created successfully Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe794fa2-93e1-496e-b292-931682d91391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Flow 'volume_create_manager' (e54e8ac4-e94a-4268-83b7-848a1cd30fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7eeacae0-4107-4ede-98f2-18c782b90b76 tempest-VolumeTypesAccessTest-357037559 None] Created volume successfully. Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Acquiring lock "cinder-65c5aafd-b804-4b60-ad65-c7fc041da5f9-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Lock "cinder-65c5aafd-b804-4b60-ad65-c7fc041da5f9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Acquiring lock "cinder-quobyte-65c5aafd-b804-4b60-ad65-c7fc041da5f9" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Lock "cinder-quobyte-65c5aafd-b804-4b60-ad65-c7fc041da5f9" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d2ba31-321b-4f87-b72e-c6107f505c5f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Acquiring lock "cinder-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Lock "cinder-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Acquiring lock "cinder-quobyte-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Lock "cinder-quobyte-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:31:16 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 Jun 27 04:31:16 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e217d-7a0b-42aa-95c6-1c174daec1da]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:31:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:17 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 Jun 27 04:31:17 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:17 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a 1073741824" returned: 0 in 1.419s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:17 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a Jun 27 04:31:17 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:17 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9" returned: 0 in 1.230s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:17 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9 Jun 27 04:31:17 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:18 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" returned: 0 in 1.668s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:18 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5 Jun 27 04:31:18 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:18 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a" returned: 0 in 1.404s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] <== create_volume: return (2925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.929s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85bea9e1-5da2-4dde-9c78-721ff840ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22ad755-d538-4250-81c1-e291010d6f0a', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398ed1e3-7d40-4c98-9a9f-75e29d0e5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:18 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Volume volume-f22ad755-d538-4250-81c1-e291010d6f0a (f22ad755-d538-4250-81c1-e291010d6f0a): created successfully Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398ed1e3-7d40-4c98-9a9f-75e29d0e5b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Flow 'volume_create_manager' (751cb554-a5c3-4149-b7ca-74c81df5f80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-644de446-a8da-4cb8-a4b2-b874c6c455dd tempest-ServerRescueNegativeTestJSON-874559293 None] Created volume successfully. Jun 27 04:31:19 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-65c5aafd-b804-4b60-ad65-c7fc041da5f9" returned: 0 in 1.395s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Lock "cinder-quobyte-65c5aafd-b804-4b60-ad65-c7fc041da5f9" released by "delete_volume" :: held 2.736s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Flow 'volume_create_manager' (8a077208-0af1-402d-aa87-55f9e34d8719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf5eeb7-0670-408e-8a1d-c1e97b849ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf5eeb7-0670-408e-8a1d-c1e97b849ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1422601094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6746f2-79ef-4daf-9c76-f108d7902c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0885cf35ccf14d8ea66a00c9e49023fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:19Z,use_quota=True,user_id='f2e3d25cf7e249e1a450d00082b6d655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8f94d2-d622-4cb4-929c-ea66928418c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8f94d2-d622-4cb4-929c-ea66928418c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3803556-5491-445c-8b4b-e28915132b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3803556-5491-445c-8b4b-e28915132b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6746f2-79ef-4daf-9c76-f108d7902c09', 'volume_name': 'volume-8e6746f2-79ef-4daf-9c76-f108d7902c09', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649201e6-ca32-4164-a83a-ff04ef4c663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649201e6-ca32-4164-a83a-ff04ef4c663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19250df-5dea-40b9-b733-69a7003d3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:19 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Volume 8e6746f2-79ef-4daf-9c76-f108d7902c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6746f2-79ef-4daf-9c76-f108d7902c09', 'volume_size': 1} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1422601094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6746f2-79ef-4daf-9c76-f108d7902c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0885cf35ccf14d8ea66a00c9e49023fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:19Z,use_quota=True,user_id='f2e3d25cf7e249e1a450d00082b6d655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Creating volume 8e6746f2-79ef-4daf-9c76-f108d7902c09 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:31:19 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:19 devstack cinder-volume[93772]: WARNING cinder.quota [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-696503914 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-696503914, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:31:19 devstack cinder-volume[93772]: WARNING cinder.quota [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-696503914 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-696503914, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:31:19 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 1073741824 Jun 27 04:31:19 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Created reservations ['15dd2951-b1e2-4bcc-b6c4-a5ca8101b922', '0363ed63-5758-4320-b392-a09cce3f44b3', 'd5273331-b623-4160-b8c8-80d08c1be3db', '3659c28b-5ed1-4fa8-abd9-509e4cf88aae'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:19 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:31:19 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:20 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" returned: 0 in 1.651s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Lock "cinder-quobyte-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5" released by "delete_volume" :: held 3.425s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Created reservations ['81e5d728-f75a-4e68-95d2-1c343b5fdd60', '60c8a026-04f8-49f4-a38a-b3b554f5d785', '7cb61bed-03bc-4998-bc07-fbcc1da451fc', 'a30fe20a-c30b-4e16-b75a-023e91a501d1'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:20 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:31:20 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:20 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:31:20 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:21 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.319s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:31:21 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.165s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:31:22 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Deleted volume successfully. Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-77ccccd7-5dc4-4bd1-b1b6-97cacd8301dc tempest-TaggedAttachmentsTest-1669511757 None] Lock "cinder-b72e14f7-7f6d-41dc-9ed4-348d4087b4a5-delete_volume" released by "delete_volume" :: held 5.407s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:31:22 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:22 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 2.472s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 1073741824" returned: 0 in 2.811s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:22 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Deleted volume successfully. Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba1dcac3-f559-4403-89c1-b96746d40c57 tempest-VolumeTypesAccessTest-357037559 None] Lock "cinder-65c5aafd-b804-4b60-ad65-c7fc041da5f9-delete_volume" released by "delete_volume" :: held 5.929s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:31:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:22 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 Jun 27 04:31:22 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:23 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09" returned: 0 in 1.281s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] <== create_volume: return (4186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.189s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19250df-5dea-40b9-b733-69a7003d3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6746f2-79ef-4daf-9c76-f108d7902c09', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e593c3-175e-4d98-b510-84b44c21956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:23 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Volume volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 (8e6746f2-79ef-4daf-9c76-f108d7902c09): created successfully Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e593c3-175e-4d98-b510-84b44c21956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Flow 'volume_create_manager' (8a077208-0af1-402d-aa87-55f9e34d8719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-32d9c19c-33ca-4673-bb64-3d82c1837e2d tempest-ServerActionsTestOtherA-69562108 None] Created volume successfully. Jun 27 04:31:33 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:31:33 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=17,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:31:41 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Flow 'volume_create_manager' (1c9bbf79-5f46-461d-b7c8-59bfd3ffaf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad11cfe8-1d6d-44ba-89d5-ba158e9e7e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad11cfe8-1d6d-44ba-89d5-ba158e9e7e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1624972026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1086b336-9f3a-454e-8e73-1b891b4e9c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70c7baf7bce42ac80767d7f6324527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:42Z,use_quota=True,user_id='1b911b041b9447b785555d359f036c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00af55d8-a8b9-4a41-a6d4-5eccd9daf28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00af55d8-a8b9-4a41-a6d4-5eccd9daf28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143a5f8e-dcf8-454b-8fd8-8d329dae8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143a5f8e-dcf8-454b-8fd8-8d329dae8418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1086b336-9f3a-454e-8e73-1b891b4e9c34', 'volume_name': 'volume-1086b336-9f3a-454e-8e73-1b891b4e9c34', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba5f9e9-502c-4735-9e3a-7c3bfc204acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba5f9e9-502c-4735-9e3a-7c3bfc204acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc09d7c-1e2a-466b-a2d7-1a9a531072e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:42 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Volume 1086b336-9f3a-454e-8e73-1b891b4e9c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1086b336-9f3a-454e-8e73-1b891b4e9c34', 'volume_size': 1} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1624972026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1086b336-9f3a-454e-8e73-1b891b4e9c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70c7baf7bce42ac80767d7f6324527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:42Z,use_quota=True,user_id='1b911b041b9447b785555d359f036c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Creating volume 1086b336-9f3a-454e-8e73-1b891b4e9c34 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:31:42 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:31:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:42 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 1073741824 Jun 27 04:31:42 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:43 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 1073741824" returned: 0 in 1.336s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:43 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 Jun 27 04:31:43 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:44 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34" returned: 0 in 0.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.225s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc09d7c-1e2a-466b-a2d7-1a9a531072e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1086b336-9f3a-454e-8e73-1b891b4e9c34', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc66261e-9b84-4813-857d-960b4be8c982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:44 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Volume volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 (1086b336-9f3a-454e-8e73-1b891b4e9c34): created successfully Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc66261e-9b84-4813-857d-960b4be8c982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Flow 'volume_create_manager' (1c9bbf79-5f46-461d-b7c8-59bfd3ffaf7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7427651b-12f7-4272-a2d9-15629845cfc7 tempest-VolumesListAdminTestJSON-376145824 None] Created volume successfully. Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Flow 'volume_create_manager' (f382aa5d-25c1-4709-a733-bffae5659103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa761e8-8bc9-47fc-970d-85231285c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa761e8-8bc9-47fc-970d-85231285c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-875218147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ce0bd8-58f3-4c45-b802-d0c7a6776f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70c7baf7bce42ac80767d7f6324527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:47Z,use_quota=True,user_id='1b911b041b9447b785555d359f036c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93447776-f4c1-4ce1-8eea-cf46133194c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93447776-f4c1-4ce1-8eea-cf46133194c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6383380f-0f94-4226-acb6-504c84538824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6383380f-0f94-4226-acb6-504c84538824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ce0bd8-58f3-4c45-b802-d0c7a6776f3b', 'volume_name': 'volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b27b649-13f4-427c-9640-3565e3fdcc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b27b649-13f4-427c-9640-3565e3fdcc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e122a-f1fa-4db0-9686-280e451e5539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:46 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Volume 35ce0bd8-58f3-4c45-b802-d0c7a6776f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b', 'volume_size': 1} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-875218147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ce0bd8-58f3-4c45-b802-d0c7a6776f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70c7baf7bce42ac80767d7f6324527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:47Z,use_quota=True,user_id='1b911b041b9447b785555d359f036c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Creating volume 35ce0bd8-58f3-4c45-b802-d0c7a6776f3b {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:31:46 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:31:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:46 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b 1073741824 Jun 27 04:31:46 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:48 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b 1073741824" returned: 0 in 1.716s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:48 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b Jun 27 04:31:48 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:50 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b" returned: 0 in 1.921s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] <== create_volume: return (3721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.732s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e122a-f1fa-4db0-9686-280e451e5539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79ae99b-8b27-4ede-b951-c07a4732a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Volume volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b (35ce0bd8-58f3-4c45-b802-d0c7a6776f3b): created successfully Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79ae99b-8b27-4ede-b951-c07a4732a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Flow 'volume_create_manager' (f382aa5d-25c1-4709-a733-bffae5659103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c9102dd6-45ba-4bff-9f4d-86253abf4193 tempest-VolumesListAdminTestJSON-376145824 None] Created volume successfully. Jun 27 04:31:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Acquiring lock "cinder-f22ad755-d538-4250-81c1-e291010d6f0a-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:31:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "cinder-f22ad755-d538-4250-81c1-e291010d6f0a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:31:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Acquiring lock "cinder-quobyte-f22ad755-d538-4250-81c1-e291010d6f0a" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:31:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "cinder-quobyte-f22ad755-d538-4250-81c1-e291010d6f0a" acquired by "delete_volume" :: waited 0.049s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:31:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef47572-44db-4800-b709-a02c59a7a0bd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:31:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:51 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a Jun 27 04:31:51 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Flow 'volume_create_manager' (6d560f18-d718-43f0-bfcd-82094ec5003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7f8a88-aa0d-4983-be5d-5f4aa601d46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7f8a88-aa0d-4983-be5d-5f4aa601d46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1026129015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc55a49-1714-4ab7-ad6c-2c5670f643ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70c7baf7bce42ac80767d7f6324527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:52Z,use_quota=True,user_id='1b911b041b9447b785555d359f036c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee0f9ab-52d2-4f89-bc18-e988ef7096b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee0f9ab-52d2-4f89-bc18-e988ef7096b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e61326-ca1e-4b4b-9c9b-9b73ae481401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e61326-ca1e-4b4b-9c9b-9b73ae481401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc55a49-1714-4ab7-ad6c-2c5670f643ff', 'volume_name': 'volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ee97fb-b2c4-4cfd-be60-f0bfbc7e3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ee97fb-b2c4-4cfd-be60-f0bfbc7e3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b9edda-ea96-435a-bcf1-f73ba1915574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Volume ecc55a49-1714-4ab7-ad6c-2c5670f643ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff', 'volume_size': 1} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1026129015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc55a49-1714-4ab7-ad6c-2c5670f643ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70c7baf7bce42ac80767d7f6324527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:31:52Z,use_quota=True,user_id='1b911b041b9447b785555d359f036c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Creating volume ecc55a49-1714-4ab7-ad6c-2c5670f643ff {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:31:52 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:31:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:52 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff 1073741824 Jun 27 04:31:52 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:53 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a" returned: 0 in 2.148s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:53 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a Jun 27 04:31:53 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:55 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff 1073741824" returned: 0 in 2.588s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:55 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f22ad755-d538-4250-81c1-e291010d6f0a" returned: 0 in 1.565s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "cinder-quobyte-f22ad755-d538-4250-81c1-e291010d6f0a" released by "delete_volume" :: held 3.813s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:55 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff Jun 27 04:31:55 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Created reservations ['2eaf16d4-866e-45b7-843a-fad81b165b11', '62c58084-4b5d-42e6-ac37-65ca580643d2', '1254ff4a-c910-4cd2-9769-15817b4fdcdd', 'c759bc78-a985-4461-9834-07d05305ce35'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:31:55 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:31:55 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:31:56 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff" returned: 0 in 1.531s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] <== create_volume: return (4304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:31:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.307s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b9edda-ea96-435a-bcf1-f73ba1915574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99af139f-0b35-48ec-b3e4-2e63e599a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:31:57 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Volume volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff (ecc55a49-1714-4ab7-ad6c-2c5670f643ff): created successfully Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99af139f-0b35-48ec-b3e4-2e63e599a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Flow 'volume_create_manager' (6d560f18-d718-43f0-bfcd-82094ec5003c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:31:57 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f27402d1-115b-4162-b707-3bbdfa2b893d tempest-VolumesListAdminTestJSON-376145824 None] Created volume successfully. Jun 27 04:31:57 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.763s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:31:57 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Deleted volume successfully. Jun 27 04:31:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0bbb4dba-8ef0-421d-b7c9-6145d6912926 tempest-ServerRescueNegativeTestJSON-874559293 None] Lock "cinder-f22ad755-d538-4250-81c1-e291010d6f0a-delete_volume" released by "delete_volume" :: held 6.188s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:00 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Flow 'volume_create_manager' (d0af0c8a-7b11-44ab-be72-8573f8eb65e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f12d358-c8fd-415b-ae64-5b2630f6e0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f12d358-c8fd-415b-ae64-5b2630f6e0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16cadd3-b19b-45ed-b844-e29d69af1af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bda9880b104b80bd0f92c40326b868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:01Z,use_quota=True,user_id='ddc01bc8ef1c420a8ed67113e46e3f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbf8193-7504-4ac0-a029-fb1c795f5cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbf8193-7504-4ac0-a029-fb1c795f5cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a78f01-c519-40c8-a21b-267223d0ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a78f01-c519-40c8-a21b-267223d0ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e16cadd3-b19b-45ed-b844-e29d69af1af3', 'volume_name': 'volume-e16cadd3-b19b-45ed-b844-e29d69af1af3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010cd0a3-57b4-4ab9-bd23-61b6e1be219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010cd0a3-57b4-4ab9-bd23-61b6e1be219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e238fd3-4a6d-427e-bae6-da58af07f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Volume e16cadd3-b19b-45ed-b844-e29d69af1af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e16cadd3-b19b-45ed-b844-e29d69af1af3', 'volume_size': 1} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e16cadd3-b19b-45ed-b844-e29d69af1af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21bda9880b104b80bd0f92c40326b868',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:01Z,use_quota=True,user_id='ddc01bc8ef1c420a8ed67113e46e3f8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Creating volume e16cadd3-b19b-45ed-b844-e29d69af1af3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:32:01 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:32:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:01 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 1073741824 Jun 27 04:32:01 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:02 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 1073741824" returned: 0 in 1.188s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:02 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 Jun 27 04:32:02 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:03 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3" returned: 0 in 0.734s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e238fd3-4a6d-427e-bae6-da58af07f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e16cadd3-b19b-45ed-b844-e29d69af1af3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0da9867-138b-4dfd-bb3c-2ac37b0d0ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:03 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Volume volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 (e16cadd3-b19b-45ed-b844-e29d69af1af3): created successfully Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0da9867-138b-4dfd-bb3c-2ac37b0d0ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Flow 'volume_create_manager' (d0af0c8a-7b11-44ab-be72-8573f8eb65e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-59236c33-beff-4e22-9601-ec3ff1f54baf tempest-VolumesListAdminTestJSON-1618718819 None] Created volume successfully. Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Acquiring lock "cinder-e16cadd3-b19b-45ed-b844-e29d69af1af3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Lock "cinder-e16cadd3-b19b-45ed-b844-e29d69af1af3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Acquiring lock "cinder-quobyte-e16cadd3-b19b-45ed-b844-e29d69af1af3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Lock "cinder-quobyte-e16cadd3-b19b-45ed-b844-e29d69af1af3" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547d5bb-30b3-458f-97de-5e5d6b269d70]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "cinder-ecc55a49-1714-4ab7-ad6c-2c5670f643ff-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-ecc55a49-1714-4ab7-ad6c-2c5670f643ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "cinder-quobyte-ecc55a49-1714-4ab7-ad6c-2c5670f643ff" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:04 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 Jun 27 04:32:04 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-quobyte-ecc55a49-1714-4ab7-ad6c-2c5670f643ff" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf022e6-5a25-48e9-ac25-28e1cf1871cd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:04 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff Jun 27 04:32:04 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:05 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3" returned: 0 in 0.802s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:05 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3 Jun 27 04:32:05 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:05 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:05 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff Jun 27 04:32:05 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:05 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e16cadd3-b19b-45ed-b844-e29d69af1af3" returned: 0 in 0.738s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Lock "cinder-quobyte-e16cadd3-b19b-45ed-b844-e29d69af1af3" released by "delete_volume" :: held 1.585s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Created reservations ['78eea8ba-1445-4044-b54d-a018bfb5210d', '97102bc0-7b21-44a5-b02a-348b4929490c', '8f3a983a-2d3f-4423-8848-a1cb3c132f04', 'df14e9c9-3ecc-4523-8374-03aef07323c1'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:06 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:06 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:06 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ecc55a49-1714-4ab7-ad6c-2c5670f643ff" returned: 0 in 0.836s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-quobyte-ecc55a49-1714-4ab7-ad6c-2c5670f643ff" released by "delete_volume" :: held 1.688s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Created reservations ['3cc90782-7752-4b7d-b3d6-05a0f46a5d4f', '71a9dd5b-0c3f-4aed-9bf7-dc4e392ba74f', 'e4325a07-1bae-44ec-a797-a884f3c650d9', '9a76130f-f621-4635-a5c3-25797fb65242'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:06 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:06 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "cinder-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:06 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.845s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Deleted volume successfully. Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "cinder-quobyte-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-012bd1e5-b5a0-464c-aaa3-e71974f4b2d0 tempest-VolumesListAdminTestJSON-1618718819 None] Lock "cinder-e16cadd3-b19b-45ed-b844-e29d69af1af3-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-quobyte-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b" acquired by "delete_volume" :: waited 0.032s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943060c-113e-456f-99af-4604209590a6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:07 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.981s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Deleted volume successfully. Jun 27 04:32:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ace37fa6-4009-4509-b0b7-ab498e0f358f tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-ecc55a49-1714-4ab7-ad6c-2c5670f643ff-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:07 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b Jun 27 04:32:07 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:08 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b" returned: 0 in 1.015s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:08 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b Jun 27 04:32:08 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:09 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b" returned: 0 in 1.317s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-quobyte-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b" released by "delete_volume" :: held 2.405s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Created reservations ['a2565693-d5ec-47fe-8a67-859656b35036', '5b267723-431e-4c7c-a25d-3d4986e760ad', 'c02a3470-3eda-4645-bdc1-a668c8f04c9f', 'a56f9fbe-bbfa-4f73-bf64-ecf363356c63'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:09 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:09 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "cinder-1086b336-9f3a-454e-8e73-1b891b4e9c34-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-1086b336-9f3a-454e-8e73-1b891b4e9c34-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:10 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.810s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "cinder-quobyte-1086b336-9f3a-454e-8e73-1b891b4e9c34" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:10 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Deleted volume successfully. Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-quobyte-1086b336-9f3a-454e-8e73-1b891b4e9c34" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86ac80be-b114-40b1-8864-e652fa40fd0b tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-35ce0bd8-58f3-4c45-b802-d0c7a6776f3b-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd75d4a-9df7-4a75-b241-fb8f4d6136fb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:10 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 Jun 27 04:32:10 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:11 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34" returned: 0 in 0.844s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:11 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34 Jun 27 04:32:11 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:12 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1086b336-9f3a-454e-8e73-1b891b4e9c34" returned: 0 in 0.739s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-quobyte-1086b336-9f3a-454e-8e73-1b891b4e9c34" released by "delete_volume" :: held 1.626s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Created reservations ['f81c70c6-a1ef-4f42-870c-602108e92d57', 'e34fe023-df59-48ec-8b42-81fcb331354c', '2c8e6be3-cccf-4528-95b9-89ce1d3fa6eb', '53616e73-3e50-492e-8c95-829d0cf5e8b2'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:12 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:12 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:13 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.917s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:13 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:13 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Deleted volume successfully. Jun 27 04:32:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2c5f938-7b21-47b5-8379-f533cfbc9779 tempest-VolumesListAdminTestJSON-376145824 None] Lock "cinder-1086b336-9f3a-454e-8e73-1b891b4e9c34-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5998816f-1f12-4575-84e2-2fd942a5aed4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:15 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 Jun 27 04:32:15 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:16 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09" returned: 0 in 1.599s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.640s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-8e6746f2-79ef-4daf-9c76-f108d7902c09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54941d32-3270-444b-9fac-83e329fa5c4a', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:32:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-1205d43b-6671-447b-914a-85851b9d6bce req-5aff2252-f35d-41ec-8d58-ff78346bca14 tempest-ServerActionsTestOtherA-69562108 None] attachment_update completed successfully. Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:20 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:20 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:21 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.153s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:26 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=51,cinder:SELECT=41,cinder:DELETE=2,cinder:INSERT=8 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:32:26 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=37,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=7 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:32:28 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-ce91a81c-9d7b-45f6-bcdd-91e4471c4bf7 tempest-ServerActionsTestOtherA-69562108 None] Terminate volume connection completed successfully. Jun 27 04:32:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-ce91a81c-9d7b-45f6-bcdd-91e4471c4bf7 tempest-ServerActionsTestOtherA-69562108 None] Deleting attachment 54941d32-3270-444b-9fac-83e329fa5c4a. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:32:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5d858-8791-416b-9786-9a8412644483]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:30 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 Jun 27 04:32:30 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Flow 'volume_create_manager' (e97a1eb0-3a4d-46a2-8a02-016b271219cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b1ed3-3604-47fc-bea2-d3fb486a7922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6b1ed3-3604-47fc-bea2-d3fb486a7922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1038168419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ea2a7d-48a9-4fed-9145-3f21b6ad7104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f568cc5c10448a5b26e7442cf9f85d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:32Z,use_quota=True,user_id='6fc7e1df453c41458ce094a219eb3f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aadd84-2623-49ad-be33-b3e3a2f7f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22aadd84-2623-49ad-be33-b3e3a2f7f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acae6f96-2aa9-4bcb-a70d-32b5652a96d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acae6f96-2aa9-4bcb-a70d-32b5652a96d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ea2a7d-48a9-4fed-9145-3f21b6ad7104', 'volume_name': 'volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4397cec-e6d5-4280-a7e0-6bd737d99bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4397cec-e6d5-4280-a7e0-6bd737d99bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf405829-e53e-4a6e-9c38-7d13825f82c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:31 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Volume 26ea2a7d-48a9-4fed-9145-3f21b6ad7104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104', 'volume_size': 1} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:31 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09" returned: 0 in 1.184s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.222s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1038168419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ea2a7d-48a9-4fed-9145-3f21b6ad7104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f568cc5c10448a5b26e7442cf9f85d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:32Z,use_quota=True,user_id='6fc7e1df453c41458ce094a219eb3f87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Creating volume 26ea2a7d-48a9-4fed-9145-3f21b6ad7104 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:32:31 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:32:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:31 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 1073741824 Jun 27 04:32:32 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-8e6746f2-79ef-4daf-9c76-f108d7902c09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e08a2a7-ac2d-43af-95ac-edfd007bc59c', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:32:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-b36ce547-72e1-400c-be08-c7fca0713ce7 req-eeb71691-c9c2-410d-8618-248160169a94 tempest-ServerActionsTestOtherA-69562108 None] attachment_update completed successfully. Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 1073741824" returned: 0 in 1.125s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:33 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:33 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 Jun 27 04:32:33 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:33 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104" returned: 0 in 0.742s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf405829-e53e-4a6e-9c38-7d13825f82c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b17242-c619-4dc9-98d2-5b2955ae37f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:33 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Volume volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 (26ea2a7d-48a9-4fed-9145-3f21b6ad7104): created successfully Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b17242-c619-4dc9-98d2-5b2955ae37f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Flow 'volume_create_manager' (e97a1eb0-3a4d-46a2-8a02-016b271219cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:33 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-525cfa66-4a03-4086-9ca2-0b4be3368f05 tempest-AbsoluteLimitsTests-862405107 None] Created volume successfully. Jun 27 04:32:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Acquiring lock "cinder-26ea2a7d-48a9-4fed-9145-3f21b6ad7104-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Lock "cinder-26ea2a7d-48a9-4fed-9145-3f21b6ad7104-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Acquiring lock "cinder-quobyte-26ea2a7d-48a9-4fed-9145-3f21b6ad7104" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Lock "cinder-quobyte-26ea2a7d-48a9-4fed-9145-3f21b6ad7104" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b6135f-f03b-4b35-9a13-e6bb75180700]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:35 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 Jun 27 04:32:35 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:36 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104" returned: 0 in 1.074s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:36 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104 Jun 27 04:32:36 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:37 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-26ea2a7d-48a9-4fed-9145-3f21b6ad7104" returned: 0 in 1.018s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Lock "cinder-quobyte-26ea2a7d-48a9-4fed-9145-3f21b6ad7104" released by "delete_volume" :: held 2.189s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Created reservations ['3c94d826-e5a9-4521-bfa3-0e93fa023ee3', 'a9523d34-ec3b-44e7-aa43-99036fa38569', '55a7175b-456e-4677-8a3e-1a7248c9c060', 'fd9a5dec-c7ac-4319-ab38-8ad9de309320'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:37 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:37 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:39 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.707s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:39 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:39 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Deleted volume successfully. Jun 27 04:32:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7df6d377-1547-4cab-801a-3d43b529cfbe tempest-AbsoluteLimitsTests-862405107 None] Lock "cinder-26ea2a7d-48a9-4fed-9145-3f21b6ad7104-delete_volume" released by "delete_volume" :: held 4.350s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:47 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Flow 'volume_create_manager' (140daa86-f6f0-47e3-92cf-87ca6b323aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf58db41-1961-4e61-a130-2f46f99ef2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf58db41-1961-4e61-a130-2f46f99ef2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2023800270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d46c54-5d9a-4d12-aef0-2356147e1a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79691310c734b6aa99620c3d271bf94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:48Z,use_quota=True,user_id='62ab0b7fc04d41f193b50d86e03d78a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5dd224-e413-4919-aec9-48c8b28122ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5dd224-e413-4919-aec9-48c8b28122ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96eaed8-d1c1-412b-9f51-f3e8b648021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96eaed8-d1c1-412b-9f51-f3e8b648021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d46c54-5d9a-4d12-aef0-2356147e1a77', 'volume_name': 'volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f803da5a-e52d-4759-8fe7-0e324e284d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f803da5a-e52d-4759-8fe7-0e324e284d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59462ea-ef9e-42df-a878-7bae565da417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:48 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Volume e0d46c54-5d9a-4d12-aef0-2356147e1a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77', 'volume_size': 1} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2023800270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d46c54-5d9a-4d12-aef0-2356147e1a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c79691310c734b6aa99620c3d271bf94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:48Z,use_quota=True,user_id='62ab0b7fc04d41f193b50d86e03d78a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Creating volume e0d46c54-5d9a-4d12-aef0-2356147e1a77 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:32:48 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:32:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:48 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 1073741824 Jun 27 04:32:48 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:49 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 1073741824" returned: 0 in 1.326s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:49 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 Jun 27 04:32:49 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:50 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77" returned: 0 in 0.753s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59462ea-ef9e-42df-a878-7bae565da417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4d6373-363a-45aa-8b0a-776c5a00b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Volume volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 (e0d46c54-5d9a-4d12-aef0-2356147e1a77): created successfully Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4d6373-363a-45aa-8b0a-776c5a00b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Flow 'volume_create_manager' (140daa86-f6f0-47e3-92cf-87ca6b323aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-650e0ac2-558d-4520-b213-1339aebb4adf tempest-VolumesMetadataTest-1407816703 None] Created volume successfully. Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Acquiring lock "cinder-e0d46c54-5d9a-4d12-aef0-2356147e1a77-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Lock "cinder-e0d46c54-5d9a-4d12-aef0-2356147e1a77-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Acquiring lock "cinder-quobyte-e0d46c54-5d9a-4d12-aef0-2356147e1a77" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Lock "cinder-quobyte-e0d46c54-5d9a-4d12-aef0-2356147e1a77" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8666679-4f4e-48e3-9e6a-c8ed7954ac26]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Flow 'volume_create_manager' (c42a66ab-1a7e-4062-a9f1-e6bc1e3fecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:52 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 Jun 27 04:32:52 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f628e388-1663-44f0-bc4e-7d262ada7faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f628e388-1663-44f0-bc4e-7d262ada7faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-601602834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b5ed86-67d8-47e3-ac72-4657cee82f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e09d3f6a1c4b33b31356c21738625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:53Z,use_quota=True,user_id='b0089d4cb58f4fcbb02b7788a15c838c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e583b1db-45bb-46c6-a33f-35af705c95c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e583b1db-45bb-46c6-a33f-35af705c95c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c04c3a-897b-4d06-a4d8-7e84c58f5c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c04c3a-897b-4d06-a4d8-7e84c58f5c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b5ed86-67d8-47e3-ac72-4657cee82f03', 'volume_name': 'volume-46b5ed86-67d8-47e3-ac72-4657cee82f03', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7d948e-3e16-4a0f-b19d-6297321240cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7d948e-3e16-4a0f-b19d-6297321240cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc89319-19bf-4d39-89eb-6102b813fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Volume 46b5ed86-67d8-47e3-ac72-4657cee82f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b5ed86-67d8-47e3-ac72-4657cee82f03', 'volume_size': 1} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-601602834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b5ed86-67d8-47e3-ac72-4657cee82f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e09d3f6a1c4b33b31356c21738625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:53Z,use_quota=True,user_id='b0089d4cb58f4fcbb02b7788a15c838c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Creating volume 46b5ed86-67d8-47e3-ac72-4657cee82f03 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:32:52 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:32:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:52 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 1073741824 Jun 27 04:32:52 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:53 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77" returned: 0 in 0.892s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:53 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77 Jun 27 04:32:53 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:53 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 1073741824" returned: 0 in 0.939s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:53 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 Jun 27 04:32:53 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:54 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e0d46c54-5d9a-4d12-aef0-2356147e1a77" returned: 0 in 0.718s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Lock "cinder-quobyte-e0d46c54-5d9a-4d12-aef0-2356147e1a77" released by "delete_volume" :: held 1.672s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Created reservations ['ecbb9652-9987-4ea5-a4c7-e5448dfa3022', '6505814c-a326-418b-a165-18bcfdf109e5', 'ddf09711-16dd-4ee1-87ca-41731362d2fe', 'b919aed4-c0b8-4a9c-9f9c-428425c66550'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:54 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:32:54 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:54 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03" returned: 0 in 0.741s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc89319-19bf-4d39-89eb-6102b813fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b5ed86-67d8-47e3-ac72-4657cee82f03', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8520f703-378b-4645-b106-f63c0b84ee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Volume volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 (46b5ed86-67d8-47e3-ac72-4657cee82f03): created successfully Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8520f703-378b-4645-b106-f63c0b84ee75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Flow 'volume_create_manager' (c42a66ab-1a7e-4062-a9f1-e6bc1e3fecdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-aa887a29-f0f9-4cc7-91c3-d36ade093e5a tempest-ServersNegativeTestJSON-1895230196 None] Created volume successfully. Jun 27 04:32:55 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.896s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:55 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:32:55 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Deleted volume successfully. Jun 27 04:32:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10715ce8-93f0-4e30-a7d1-988cca29f70b tempest-VolumesMetadataTest-1407816703 None] Lock "cinder-e0d46c54-5d9a-4d12-aef0-2356147e1a77-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Flow 'volume_create_manager' (7a338b9e-866d-4ff8-a796-421296e3c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8370165-3e07-4727-804f-a8fba2862665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8370165-3e07-4727-804f-a8fba2862665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-854409848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2fc328-afae-4464-ae92-2414fdd524cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e09d3f6a1c4b33b31356c21738625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:57Z,use_quota=True,user_id='b0089d4cb58f4fcbb02b7788a15c838c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cccd660-1e01-44db-8064-d47a031a3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cccd660-1e01-44db-8064-d47a031a3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6cc45d-2e7d-486e-aaa3-b095542ff6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6cc45d-2e7d-486e-aaa3-b095542ff6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd2fc328-afae-4464-ae92-2414fdd524cf', 'volume_name': 'volume-bd2fc328-afae-4464-ae92-2414fdd524cf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f9a999-e1d5-4ae4-ac02-f64273797a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f9a999-e1d5-4ae4-ac02-f64273797a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d945e810-341c-4f23-a18d-8749fe8e6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Volume bd2fc328-afae-4464-ae92-2414fdd524cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd2fc328-afae-4464-ae92-2414fdd524cf', 'volume_size': 1} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-854409848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2fc328-afae-4464-ae92-2414fdd524cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e09d3f6a1c4b33b31356c21738625e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:57Z,use_quota=True,user_id='b0089d4cb58f4fcbb02b7788a15c838c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Creating volume bd2fc328-afae-4464-ae92-2414fdd524cf {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:32:56 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:32:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:56 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf 1073741824 Jun 27 04:32:56 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:58 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf 1073741824" returned: 0 in 1.087s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:58 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf Jun 27 04:32:58 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:58 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf" returned: 0 in 0.806s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Flow 'volume_create_manager' (cb17ce4c-19f2-4725-95d2-355d3fe0fa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b3b712-cd1d-41a0-8934-1cb76ea0d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d945e810-341c-4f23-a18d-8749fe8e6532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd2fc328-afae-4464-ae92-2414fdd524cf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f736356-232f-4c32-854f-9db9d3c45f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b3b712-cd1d-41a0-8934-1cb76ea0d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1613398928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d82439-abe0-413c-9d4f-bee5324c746f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b23c9d1343c1b5d1e6194afe25c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:59Z,use_quota=True,user_id='7a2c630212154debb92d25f8cc54c022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4596c00-ca67-4ab1-aebf-5e26e5c28a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4596c00-ca67-4ab1-aebf-5e26e5c28a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd93ec50-160d-4060-9af4-6c00eaeafdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd93ec50-160d-4060-9af4-6c00eaeafdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d82439-abe0-413c-9d4f-bee5324c746f', 'volume_name': 'volume-e1d82439-abe0-413c-9d4f-bee5324c746f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a826a47-ddb6-437d-9599-4f81661264fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a826a47-ddb6-437d-9599-4f81661264fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107132a1-3577-48f3-a858-dc49013e7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:32:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Volume e1d82439-abe0-413c-9d4f-bee5324c746f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d82439-abe0-413c-9d4f-bee5324c746f', 'volume_size': 1} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1613398928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d82439-abe0-413c-9d4f-bee5324c746f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b23c9d1343c1b5d1e6194afe25c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:32:59Z,use_quota=True,user_id='7a2c630212154debb92d25f8cc54c022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Creating volume e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:32:58 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:32:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:59 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Volume volume-bd2fc328-afae-4464-ae92-2414fdd524cf (bd2fc328-afae-4464-ae92-2414fdd524cf): created successfully Jun 27 04:32:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f736356-232f-4c32-854f-9db9d3c45f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:32:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Flow 'volume_create_manager' (7a338b9e-866d-4ff8-a796-421296e3c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:32:59 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f 1073741824 Jun 27 04:32:59 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:32:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-81f9b4f7-fcad-41f1-8a1f-5d41a858ccb1 tempest-ServersNegativeTestJSON-1895230196 None] Created volume successfully. Jun 27 04:32:59 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jun 27 04:32:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f 1073741824" returned: 0 in 0.907s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:32:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:32:59 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:32:59 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "cinder-bd2fc328-afae-4464-ae92-2414fdd524cf-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-bd2fc328-afae-4464-ae92-2414fdd524cf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "cinder-quobyte-bd2fc328-afae-4464-ae92-2414fdd524cf" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-quobyte-bd2fc328-afae-4464-ae92-2414fdd524cf" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d873d11-691e-4a07-a6ba-e7196ccf222d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:00 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 0.761s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107132a1-3577-48f3-a858-dc49013e7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d82439-abe0-413c-9d4f-bee5324c746f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6305125-f869-454c-9473-6585ada5fc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:00 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf Jun 27 04:33:00 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:00 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Volume volume-e1d82439-abe0-413c-9d4f-bee5324c746f (e1d82439-abe0-413c-9d4f-bee5324c746f): created successfully Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6305125-f869-454c-9473-6585ada5fc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Flow 'volume_create_manager' (cb17ce4c-19f2-4725-95d2-355d3fe0fa99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-62e77ad2-569c-46df-9891-cfde22239067 tempest-VolumesCloneTest-1024024020 None] Created volume successfully. Jun 27 04:33:01 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf" returned: 0 in 0.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:01 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf Jun 27 04:33:01 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Flow 'volume_create_manager' (7555c04d-14e1-4bbc-aea4-6475aaa2e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea35693-c057-49ec-9237-44d2f311f6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea35693-c057-49ec-9237-44d2f311f6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-869421910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4681741-d357-45e6-946e-f4f2d1665c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b23c9d1343c1b5d1e6194afe25c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e1d82439-abe0-413c-9d4f-bee5324c746f,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:01Z,use_quota=True,user_id='7a2c630212154debb92d25f8cc54c022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e04e046-70ac-41f4-88cb-f339e9ad48a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e04e046-70ac-41f4-88cb-f339e9ad48a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdb6396-941d-425d-9e46-fef64b358f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdb6396-941d-425d-9e46-fef64b358f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e4681741-d357-45e6-946e-f4f2d1665c14', 'volume_name': 'volume-e4681741-d357-45e6-946e-f4f2d1665c14', 'volume_size': 2, 'source_volid': 'e1d82439-abe0-413c-9d4f-bee5324c746f', 'source_volstatus': 'available'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45472862-cc33-4cac-bfe0-2d1523b6b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45472862-cc33-4cac-bfe0-2d1523b6b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768731be-6d86-4d7d-9b81-93177a899660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Volume e4681741-d357-45e6-946e-f4f2d1665c14: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e4681741-d357-45e6-946e-f4f2d1665c14', 'volume_size': 2, 'source_volid': 'e1d82439-abe0-413c-9d4f-bee5324c746f', 'source_volstatus': 'available'} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:01 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Cloning volume e1d82439-abe0-413c-9d4f-bee5324c746f to volume e4681741-d357-45e6-946e-f4f2d1665c14 Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Creating offline snapshot b7ca669f-2082-44ea-bfc2-6107775ce89a of volume e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c98723-9a79-4aa8-a5bf-b235a0e6ae05]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:01 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:33:01 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:02 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bd2fc328-afae-4464-ae92-2414fdd524cf" returned: 0 in 0.748s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-quobyte-bd2fc328-afae-4464-ae92-2414fdd524cf" released by "delete_volume" :: held 1.617s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Created reservations ['abec895b-12d2-4df0-80fc-d5dbf1b2990d', 'd4e3614f-e895-469d-8ea9-9ca9d1b2ae2b', '1500334a-7314-4a56-96dd-ca7a4efbe4b0', 'fb7c6389-54b5-4e9c-a22e-c12514a1841f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:02 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:02 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:02 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 0.952s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:02 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a 1G Jun 27 04:33:02 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "cinder-46b5ed86-67d8-47e3-ac72-4657cee82f03-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-46b5ed86-67d8-47e3-ac72-4657cee82f03-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "cinder-quobyte-46b5ed86-67d8-47e3-ac72-4657cee82f03" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-quobyte-46b5ed86-67d8-47e3-ac72-4657cee82f03" acquired by "delete_volume" :: waited 0.050s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5fbb4-5d62-4747-8ac2-0e720313ceea]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:03 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 Jun 27 04:33:03 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:03 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.326s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Deleted volume successfully. Jun 27 04:33:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a3842aeb-acaa-4a84-8803-5cccf5f472a8 tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-bd2fc328-afae-4464-ae92-2414fdd524cf-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:04 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a 1G" returned: 0 in 1.432s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d82439-abe0-413c-9d4f-bee5324c746f -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:04 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d82439-abe0-413c-9d4f-bee5324c746f -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a Jun 27 04:33:04 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:04 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03" returned: 0 in 1.041s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:04 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03 Jun 27 04:33:04 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:04 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1d82439-abe0-413c-9d4f-bee5324c746f -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a" returned: 0 in 0.882s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:04 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a is being set with open permissions: ugo+rw Jun 27 04:33:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:04 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a Jun 27 04:33:04 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:05 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-46b5ed86-67d8-47e3-ac72-4657cee82f03" returned: 0 in 0.950s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-quobyte-46b5ed86-67d8-47e3-ac72-4657cee82f03" released by "delete_volume" :: held 2.125s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Created reservations ['a1e25347-d1ee-4bbc-a8b3-fe4fb285103b', 'ed12ec64-f06f-4972-bc6c-be4bb8af1ca7', '43e6d12c-ae72-4fcb-ba73-5f3a85c59044', '8aec4490-68b0-4282-8821-5b16a9cf8ec2'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:05 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:05 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:06 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a" returned: 0 in 1.135s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:06 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info Jun 27 04:33:06 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:06 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.381s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:06 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Deleted volume successfully. Jun 27 04:33:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3aa10be5-6b2f-474a-b733-0c50483c6eaf tempest-ServersNegativeTestJSON-1895230196 None] Lock "cinder-46b5ed86-67d8-47e3-ac72-4657cee82f03-delete_volume" released by "delete_volume" :: held 4.058s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:07 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info" returned: 0 in 1.017s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:07 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info is being set with open permissions: ugo+rw Jun 27 04:33:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:07 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info Jun 27 04:33:07 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:08 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.info" returned: 0 in 1.229s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "cinder-quobyte-e4681741-d357-45e6-946e-f4f2d1665c14" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-e4681741-d357-45e6-946e-f4f2d1665c14" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] snapshot: b7ca669f-2082-44ea-bfc2-6107775ce89a, volume: e4681741-d357-45e6-946e-f4f2d1665c14, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f5dced-ca62-4e69-8055-b7cd131c8154]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:08 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a Jun 27 04:33:08 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-96bfe9fb-36fe-4193-9340-3a86ec29703a req-7bda1349-4725-4841-addf-2048c1e17fd7 tempest-ServerActionsTestOtherA-69562108 None] Terminate volume connection completed successfully. Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-96bfe9fb-36fe-4193-9340-3a86ec29703a req-7bda1349-4725-4841-addf-2048c1e17fd7 tempest-ServerActionsTestOtherA-69562108 None] Deleting attachment 5e08a2a7-ac2d-43af-95ac-edfd007bc59c. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:33:09 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a" returned: 0 in 1.292s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d82439-abe0-413c-9d4f-bee5324c746f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3099de8f-9dbd-4a14-b9b9-99e0ea42df63]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:10 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:33:10 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:11 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 1.168s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:11 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:33:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:11 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 Jun 27 04:33:11 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:16 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=42,cinder:UPDATE=53,cinder:DELETE=6,cinder:INSERT=12 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:33:19 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=29,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:33:19 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14" returned: 0 in 8.719s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3bbe1b-dcfb-4df0-8a35-723e1c7ac25f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:20 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:33:20 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:20 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:20 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:20 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 1.079s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f, size 1024.00 MB, duration 8.72 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:33:20 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Converted 1024.00 MB image at 117.41 MB/s Jun 27 04:33:20 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 is being set with open permissions: ugo+rw Jun 27 04:33:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:21 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 Jun 27 04:33:21 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:21 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.796s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:21 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14" returned: 0 in 0.746s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-e4681741-d357-45e6-946e-f4f2d1665c14" released by "_copy_volume_from_snapshot" :: held 13.171s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "cinder-quobyte-b7ca669f-2082-44ea-bfc2-6107775ce89a" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-b7ca669f-2082-44ea-bfc2-6107775ce89a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Deleting offline snapshot b7ca669f-2082-44ea-bfc2-6107775ce89a of volume e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] snapshot_file for this snap is: volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb579200-c379-46fd-ba6b-0a3c078253f3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:21 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a Jun 27 04:33:21 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:22 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a" returned: 0 in 1.012s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1d82439-abe0-413c-9d4f-bee5324c746f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:33:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86b6a8-63f2-42cb-bc1d-5ca6f86e5746]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:22 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:33:22 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "cinder-8e6746f2-79ef-4daf-9c76-f108d7902c09-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Lock "cinder-8e6746f2-79ef-4daf-9c76-f108d7902c09-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "cinder-quobyte-8e6746f2-79ef-4daf-9c76-f108d7902c09" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Lock "cinder-quobyte-8e6746f2-79ef-4daf-9c76-f108d7902c09" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[496bc263-b861-4c93-8053-4212a4913f38]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:23 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 Jun 27 04:33:23 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:23 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 0.997s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:23 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a Jun 27 04:33:23 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:24 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09" returned: 0 in 0.888s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:24 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09 Jun 27 04:33:24 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:24 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a" returned: 0 in 0.925s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:24 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a Jun 27 04:33:24 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:25 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-8e6746f2-79ef-4daf-9c76-f108d7902c09" returned: 0 in 0.798s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Lock "cinder-quobyte-8e6746f2-79ef-4daf-9c76-f108d7902c09" released by "delete_volume" :: held 1.745s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Created reservations ['956ad37b-72d8-49fb-94af-710e51ced45c', 'a1fbc927-8785-48d0-8dc2-d2f4843cfb9b', 'ef5ab8d3-701f-40c6-a54b-4b79a7c98ae8', '576171c2-c105-4328-8a03-57b12288c64f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:25 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:25 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:25 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f.b7ca669f-2082-44ea-bfc2-6107775ce89a" returned: 0 in 0.792s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-b7ca669f-2082-44ea-bfc2-6107775ce89a" released by "_delete_snapshot" :: held 3.851s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.070s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768731be-6d86-4d7d-9b81-93177a899660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4681741-d357-45e6-946e-f4f2d1665c14', 'volume_size': 2, 'source_volid': 'e1d82439-abe0-413c-9d4f-bee5324c746f', 'source_volstatus': 'available'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2633ccff-128b-4dab-9e15-b67f6a1a14d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:25 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Volume volume-e4681741-d357-45e6-946e-f4f2d1665c14 (e4681741-d357-45e6-946e-f4f2d1665c14): created successfully Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2633ccff-128b-4dab-9e15-b67f6a1a14d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Flow 'volume_create_manager' (7555c04d-14e1-4bbc-aea4-6475aaa2e351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:25 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2b6e80d1-2934-4371-84a9-6a9b69435cc6 tempest-VolumesCloneTest-1024024020 None] Created volume successfully. Jun 27 04:33:26 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.911s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:26 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Deleted volume successfully. Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7a27a2ab-e090-4297-9093-76b2abf5c27d tempest-ServerActionsTestOtherA-69562108 None] Lock "cinder-8e6746f2-79ef-4daf-9c76-f108d7902c09-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Acquiring lock "cinder-e4681741-d357-45e6-946e-f4f2d1665c14-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Lock "cinder-e4681741-d357-45e6-946e-f4f2d1665c14-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Acquiring lock "cinder-quobyte-e4681741-d357-45e6-946e-f4f2d1665c14" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-e4681741-d357-45e6-946e-f4f2d1665c14" acquired by "delete_volume" :: waited 0.055s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ebf31-2c85-4aeb-8414-fd63f1c01a8f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:27 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 Jun 27 04:33:27 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14" returned: 0 in 1.335s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:28 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:28 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14 Jun 27 04:33:28 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:29 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4681741-d357-45e6-946e-f4f2d1665c14" returned: 0 in 0.723s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-e4681741-d357-45e6-946e-f4f2d1665c14" released by "delete_volume" :: held 2.126s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Created reservations ['7de2ff56-c222-4afd-819a-ed326f98a02f', 'b910955c-554f-4bf5-96f7-12d6d34911bc', '89c3eebb-11cd-45c2-a94a-572024fe5aaa', 'fc3e147e-e1f9-465c-adca-c935a6f25a96'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:29 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:29 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:29 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.699s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:29 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Deleted volume successfully. Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-391fdcff-8227-4d40-8ccc-d483c45515ae tempest-VolumesCloneTest-1024024020 None] Lock "cinder-e4681741-d357-45e6-946e-f4f2d1665c14-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "cinder-e1d82439-abe0-413c-9d4f-bee5324c746f-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-e1d82439-abe0-413c-9d4f-bee5324c746f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "cinder-quobyte-e1d82439-abe0-413c-9d4f-bee5324c746f" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-e1d82439-abe0-413c-9d4f-bee5324c746f" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b27888-d68c-4afd-ae97-a1767024fc33]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:30 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:33:30 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:31 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 0.856s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:31 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f Jun 27 04:33:31 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:32 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1d82439-abe0-413c-9d4f-bee5324c746f" returned: 0 in 0.686s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-quobyte-e1d82439-abe0-413c-9d4f-bee5324c746f" released by "delete_volume" :: held 1.629s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Created reservations ['764fb1fe-4b93-4144-8f21-102ec14b87fd', '8c61cfee-800c-4743-b5ee-4a2c088e77bc', 'f1c28efb-f380-42b4-958f-85ac7413927e', 'ef9eace2-4373-4187-80ec-79d529570b08'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:32 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:32 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:33 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.033s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:33 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:33 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Deleted volume successfully. Jun 27 04:33:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dd61b521-9c1c-4a04-a53c-39ecc2efab30 tempest-VolumesCloneTest-1024024020 None] Lock "cinder-e1d82439-abe0-413c-9d4f-bee5324c746f-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:33 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:33:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Flow 'volume_create_manager' (0c3f0bf7-7e12-481a-9e23-c98db658f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924400ce-0891-45a4-b2e5-0995aca7c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (924400ce-0891-45a4-b2e5-0995aca7c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-64287852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fafb14b-b152-4979-9dc3-b42df84d0f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21fb517f2f40a395a73f9535998073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:34Z,use_quota=True,user_id='e66eb9bd25b241aeb8f18d8b3d6b684e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d96a22f-7df6-4e9e-9a3b-aaab3226bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d96a22f-7df6-4e9e-9a3b-aaab3226bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729fc151-a829-4265-9c9d-dbb3af0770cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729fc151-a829-4265-9c9d-dbb3af0770cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fafb14b-b152-4979-9dc3-b42df84d0f0f', 'volume_name': 'volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03582cec-01d7-4120-8def-c90dcb71e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03582cec-01d7-4120-8def-c90dcb71e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45557a3f-0b26-4cf5-b9cb-2d452725c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:34 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Volume 5fafb14b-b152-4979-9dc3-b42df84d0f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f', 'volume_size': 1} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-64287852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fafb14b-b152-4979-9dc3-b42df84d0f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21fb517f2f40a395a73f9535998073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:34Z,use_quota=True,user_id='e66eb9bd25b241aeb8f18d8b3d6b684e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Creating volume 5fafb14b-b152-4979-9dc3-b42df84d0f0f {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:33:34 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:33:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:34 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f 1073741824 Jun 27 04:33:34 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f 1073741824" returned: 0 in 1.087s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:35 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:35 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f Jun 27 04:33:35 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:36 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f" returned: 0 in 0.863s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45557a3f-0b26-4cf5-b9cb-2d452725c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066f8f9-c968-4225-b86a-bbc5839bdfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:36 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Volume volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f (5fafb14b-b152-4979-9dc3-b42df84d0f0f): created successfully Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066f8f9-c968-4225-b86a-bbc5839bdfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Flow 'volume_create_manager' (0c3f0bf7-7e12-481a-9e23-c98db658f872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-603a2ef6-b01c-440b-ba61-43b0807de04b tempest-AttachVolumeNegativeTest-966199752 None] Created volume successfully. Jun 27 04:33:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a76a53-5d6e-40f6-8433-515f99e550d3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:40 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f Jun 27 04:33:40 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:41 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.959s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '982212aa-352f-4b68-bf10-8b1bcfb70c35', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:33:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-63b5b1dc-e1bf-4f1c-9e6b-fefddd462992 req-50804f33-91bb-4801-86d4-4bd0a4007246 tempest-AttachVolumeNegativeTest-966199752 None] attachment_update completed successfully. Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Flow 'volume_create_manager' (56c64c6f-e83a-4e3d-b645-d59cb1e5b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e5ee7-5ea5-435b-89ab-2eab54a1552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388e5ee7-5ea5-435b-89ab-2eab54a1552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-785520395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23f78f-a4fa-4618-a446-b735a71ec6a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be58cf8fdd0649309d123579f1d4e2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:47Z,use_quota=True,user_id='264e9c181b9d47c4bffffb1580927ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a087262c-af4d-4b10-8cbf-b8b01ae87aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a087262c-af4d-4b10-8cbf-b8b01ae87aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8493c7f1-311f-41cc-a560-097f25c705c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8493c7f1-311f-41cc-a560-097f25c705c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed23f78f-a4fa-4618-a446-b735a71ec6a8', 'volume_name': 'volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d81b8a-1325-46a5-9460-36d5305e62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d81b8a-1325-46a5-9460-36d5305e62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4126dbb1-ccef-4f96-ac69-e7e0741c523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:47 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Volume ed23f78f-a4fa-4618-a446-b735a71ec6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8', 'volume_size': 1} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-785520395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed23f78f-a4fa-4618-a446-b735a71ec6a8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='be58cf8fdd0649309d123579f1d4e2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:47Z,use_quota=True,user_id='264e9c181b9d47c4bffffb1580927ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Creating volume ed23f78f-a4fa-4618-a446-b735a71ec6a8 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:33:47 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:33:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:47 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 1073741824 Jun 27 04:33:47 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:48 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 1073741824" returned: 0 in 1.005s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:48 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 Jun 27 04:33:48 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:49 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4126dbb1-ccef-4f96-ac69-e7e0741c523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9af2e13-f11d-495e-99bf-af3553c6dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:49 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Volume volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 (ed23f78f-a4fa-4618-a446-b735a71ec6a8): created successfully Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9af2e13-f11d-495e-99bf-af3553c6dee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Flow 'volume_create_manager' (56c64c6f-e83a-4e3d-b645-d59cb1e5b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-3ac4c8a3-e654-447f-a36a-4728297da239 req-cbb8163c-908b-4190-9d1a-88268218ab8e tempest-VolumesGetTestJSON-136470509 None] Created volume successfully. Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Acquiring lock "cinder-ed23f78f-a4fa-4618-a446-b735a71ec6a8-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Lock "cinder-ed23f78f-a4fa-4618-a446-b735a71ec6a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Acquiring lock "cinder-quobyte-ed23f78f-a4fa-4618-a446-b735a71ec6a8" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Lock "cinder-quobyte-ed23f78f-a4fa-4618-a446-b735a71ec6a8" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0866a50c-8fc8-45e5-9c55-ba5927321208]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:50 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 Jun 27 04:33:50 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:51 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8" returned: 0 in 1.213s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:51 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8 Jun 27 04:33:51 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:52 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ed23f78f-a4fa-4618-a446-b735a71ec6a8" returned: 0 in 1.083s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Lock "cinder-quobyte-ed23f78f-a4fa-4618-a446-b735a71ec6a8" released by "delete_volume" :: held 2.381s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG cinder.quota [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Created reservations ['b99884f2-af21-41ad-bf98-38e117719f3d', '40b980a4-036a-4f40-b42c-4db7aad0b349', '730778c3-3f83-4742-b775-629c49535895', '7e61255c-61ee-4003-b8db-e110b4001298'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:52 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:33:52 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:53 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.038s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:53 devstack cinder-volume[93772]: DEBUG cinder.manager [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:33:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Deleted volume successfully. Jun 27 04:33:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-219e4dc7-aa9b-4781-96e3-3ed67452d26c req-c8884d31-b41c-4ae9-b0fc-67bfe06999b2 tempest-VolumesGetTestJSON-136470509 None] Lock "cinder-ed23f78f-a4fa-4618-a446-b735a71ec6a8-delete_volume" released by "delete_volume" :: held 3.662s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (3480290c-1cf6-4c6b-9d6b-82a038f95d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6c0b15-03fc-47cc-86c5-4c1d7e9147bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6c0b15-03fc-47cc-86c5-4c1d7e9147bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1968227227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60392495-fef3-4a06-b025-6f9202338987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:54Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da6b22b-ff51-46e9-b67b-6a57b5393a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da6b22b-ff51-46e9-b67b-6a57b5393a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50222663-0e4b-4755-a8d3-c1e52c6b7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50222663-0e4b-4755-a8d3-c1e52c6b7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60392495-fef3-4a06-b025-6f9202338987', 'volume_name': 'volume-60392495-fef3-4a06-b025-6f9202338987', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c34608f-f9dc-4d74-aa24-b71586984ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c34608f-f9dc-4d74-aa24-b71586984ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee7e32e-853c-473a-8876-8df0ae87478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Volume 60392495-fef3-4a06-b025-6f9202338987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60392495-fef3-4a06-b025-6f9202338987', 'volume_size': 1} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1968227227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60392495-fef3-4a06-b025-6f9202338987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:54Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Creating volume 60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:33:54 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:33:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:54 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 1073741824 Jun 27 04:33:54 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:55 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 1073741824" returned: 0 in 1.097s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:55 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 Jun 27 04:33:55 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:56 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987" returned: 0 in 0.900s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee7e32e-853c-473a-8876-8df0ae87478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60392495-fef3-4a06-b025-6f9202338987', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb28883-d4ec-4808-9f61-2254762107de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Volume volume-60392495-fef3-4a06-b025-6f9202338987 (60392495-fef3-4a06-b025-6f9202338987): created successfully Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb28883-d4ec-4808-9f61-2254762107de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (3480290c-1cf6-4c6b-9d6b-82a038f95d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-720cdb3d-f4b4-4372-8351-15a4d9c80383 tempest-VolumesSnapshotTestJSON-1814153431 None] Created volume successfully. Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Creating offline snapshot d6effe5b-b242-4a24-a991-58b87cc49ca0 of volume 60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Flow 'volume_create_manager' (d2117440-ccf7-4b36-892d-4acf256b591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a6323f-8c06-4f1a-8651-847a4b3da345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82184bb-dddb-4fbf-a039-ef324b3d010d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a6323f-8c06-4f1a-8651-847a4b3da345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-524433371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe1ffc6-57e9-4489-bcf1-4619eda8b992,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='040dd23611c84aeea7c3cb1fbb7590d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:58Z,use_quota=True,user_id='92c00aecbb964a9295713ff339b7ee1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f05adc-6802-42c8-9e9f-1c92600ea058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f05adc-6802-42c8-9e9f-1c92600ea058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db73c1a-ac56-4e31-9cad-7edb6f726a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db73c1a-ac56-4e31-9cad-7edb6f726a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe1ffc6-57e9-4489-bcf1-4619eda8b992', 'volume_name': 'volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f6292e-b229-49a7-9c0f-edbb2247ff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f6292e-b229-49a7-9c0f-edbb2247ff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8457e977-f707-4aa3-88bd-bd4822bd7416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:33:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Volume 5fe1ffc6-57e9-4489-bcf1-4619eda8b992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992', 'volume_size': 1} Jun 27 04:33:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:33:58 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 Jun 27 04:33:58 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:33:59 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jun 27 04:33:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987" returned: 0 in 0.895s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:33:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:33:59 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 1G Jun 27 04:33:59 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:00 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 1G" returned: 0 in 1.136s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60392495-fef3-4a06-b025-6f9202338987 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:00 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60392495-fef3-4a06-b025-6f9202338987 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 Jun 27 04:34:00 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:01 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60392495-fef3-4a06-b025-6f9202338987 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0" returned: 0 in 1.087s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:01 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 is being set with open permissions: ugo+rw Jun 27 04:34:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:01 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 Jun 27 04:34:01 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:01 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0" returned: 0 in 0.716s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:02 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info Jun 27 04:34:02 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:02 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info" returned: 0 in 0.791s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:02 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info is being set with open permissions: ugo+rw Jun 27 04:34:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:02 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info Jun 27 04:34:02 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:03 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.info" returned: 0 in 0.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.587s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.341s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-524433371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe1ffc6-57e9-4489-bcf1-4619eda8b992,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='040dd23611c84aeea7c3cb1fbb7590d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:33:58Z,use_quota=True,user_id='92c00aecbb964a9295713ff339b7ee1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Creating volume 5fe1ffc6-57e9-4489-bcf1-4619eda8b992 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:03 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:03 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 1073741824 Jun 27 04:34:03 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9d009e4f-8d26-4819-b5c5-27d2936a34be tempest-VolumesSnapshotTestJSON-1814153431 None] Create snapshot completed successfully Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-d6effe5b-b242-4a24-a991-58b87cc49ca0-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-d6effe5b-b242-4a24-a991-58b87cc49ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-60392495-fef3-4a06-b025-6f9202338987" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-60392495-fef3-4a06-b025-6f9202338987" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-d6effe5b-b242-4a24-a991-58b87cc49ca0" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-d6effe5b-b242-4a24-a991-58b87cc49ca0" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleting offline snapshot d6effe5b-b242-4a24-a991-58b87cc49ca0 of volume 60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] snapshot_file for this snap is: volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ba1c5-7d24-471a-b28e-5cd9908919e4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:05 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 Jun 27 04:34:05 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:05 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 1073741824" returned: 0 in 1.992s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:05 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 Jun 27 04:34:05 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:06 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0" returned: 0 in 2.014s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60392495-fef3-4a06-b025-6f9202338987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:34:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a34fe6-5a26-45ff-bd03-ef3e3301e9d4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:07 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992" returned: 0 in 1.318s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] <== create_volume: return (3403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.406s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8457e977-f707-4aa3-88bd-bd4822bd7416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48de88dd-fc7c-48b6-85cb-9c41fbb22257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:07 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Volume volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 (5fe1ffc6-57e9-4489-bcf1-4619eda8b992): created successfully Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48de88dd-fc7c-48b6-85cb-9c41fbb22257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Flow 'volume_create_manager' (d2117440-ccf7-4b36-892d-4acf256b591a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:07 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 Jun 27 04:34:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ef8fbf87-c334-44e2-92e0-4b59fe4a93c3 tempest-VolumesTestJSON-1527652726 None] Created volume successfully. Jun 27 04:34:07 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:07 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987" returned: 0 in 1.008s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:07 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 Jun 27 04:34:07 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Flow 'volume_create_manager' (c60baf75-e75a-489e-8d70-cc0b7b3a2dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10645639-5625-4a02-ae28-7d2260b6d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10645639-5625-4a02-ae28-7d2260b6d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1489808221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f26109-5e06-44c0-8977-0edc6645d40f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='040dd23611c84aeea7c3cb1fbb7590d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:09Z,use_quota=True,user_id='92c00aecbb964a9295713ff339b7ee1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7c9f09-8672-40d6-b102-8b914aa41d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7c9f09-8672-40d6-b102-8b914aa41d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d72811-fc31-4bbf-bdb5-5be6c36b0bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d72811-fc31-4bbf-bdb5-5be6c36b0bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f26109-5e06-44c0-8977-0edc6645d40f', 'volume_name': 'volume-05f26109-5e06-44c0-8977-0edc6645d40f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fa9239-01e3-460f-ab99-17fd5fb37790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fa9239-01e3-460f-ab99-17fd5fb37790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e363e6-6168-4976-bf04-e2d534e6fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Volume 05f26109-5e06-44c0-8977-0edc6645d40f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f26109-5e06-44c0-8977-0edc6645d40f', 'volume_size': 1} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1489808221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f26109-5e06-44c0-8977-0edc6645d40f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='040dd23611c84aeea7c3cb1fbb7590d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:09Z,use_quota=True,user_id='92c00aecbb964a9295713ff339b7ee1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Creating volume 05f26109-5e06-44c0-8977-0edc6645d40f {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:09 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:09 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f 1073741824 Jun 27 04:34:09 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:09 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0" returned: 0 in 1.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:09 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0 Jun 27 04:34:09 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:11 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987.d6effe5b-b242-4a24-a991-58b87cc49ca0" returned: 0 in 1.323s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-d6effe5b-b242-4a24-a991-58b87cc49ca0" released by "_delete_snapshot" :: held 6.502s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-60392495-fef3-4a06-b025-6f9202338987" released by "delete_snapshot" :: held 6.560s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:11 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['c5fe13a6-67ce-448b-b664-84f0cb9207ca', '90a5c2fb-0995-4781-9b33-46fa72e85c22', 'e92328ac-2d04-43a7-8a80-5a1ab328f077', '6c366153-2505-4105-b6b2-8f8a2e44c567'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f 1073741824" returned: 0 in 1.973s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Delete snapshot completed successfully. Jun 27 04:34:11 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f Jun 27 04:34:11 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aeab6801-5e8f-4656-9765-ebe7f5194069 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-d6effe5b-b242-4a24-a991-58b87cc49ca0-delete_snapshot" released by "delete_snapshot" :: held 6.914s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:12 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f" returned: 0 in 0.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e363e6-6168-4976-bf04-e2d534e6fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f26109-5e06-44c0-8977-0edc6645d40f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffa0e96-5819-46d3-aab2-05d7371dc1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:12 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Volume volume-05f26109-5e06-44c0-8977-0edc6645d40f (05f26109-5e06-44c0-8977-0edc6645d40f): created successfully Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffa0e96-5819-46d3-aab2-05d7371dc1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Flow 'volume_create_manager' (c60baf75-e75a-489e-8d70-cc0b7b3a2dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:12 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f2b557b6-b809-448c-b5f4-0bc5aa7ac361 tempest-VolumesTestJSON-1527652726 None] Created volume successfully. Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (a65a8e13-2093-47d2-bac1-a7f212a54478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a684e5bb-c4da-4317-bfc8-997fb2f87221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a684e5bb-c4da-4317-bfc8-997fb2f87221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1888357493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e2b792-662e-4fbb-b097-af69edff93d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:13Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cb9345-a87a-43c3-9a32-6da5b44c2e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cb9345-a87a-43c3-9a32-6da5b44c2e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7e591d-97d9-4669-89fd-1a1c87800421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7e591d-97d9-4669-89fd-1a1c87800421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e2b792-662e-4fbb-b097-af69edff93d3', 'volume_name': 'volume-a8e2b792-662e-4fbb-b097-af69edff93d3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172c4856-f598-4604-ae3a-4681df1e9123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172c4856-f598-4604-ae3a-4681df1e9123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e600fc46-b4c8-4831-aaa6-b447d7470f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:13 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Volume a8e2b792-662e-4fbb-b097-af69edff93d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e2b792-662e-4fbb-b097-af69edff93d3', 'volume_size': 1} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1888357493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e2b792-662e-4fbb-b097-af69edff93d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:13Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Creating volume a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:13 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:13 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 1073741824 Jun 27 04:34:13 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:14 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 1073741824" returned: 0 in 1.048s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Flow 'volume_create_manager' (658bfbfd-95d7-4b4f-8667-b63dd1de0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907147d-3439-4516-a7ce-10bf157e216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2907147d-3439-4516-a7ce-10bf157e216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2091471962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0ca9d1-b04e-413d-9efa-8019601af1e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='040dd23611c84aeea7c3cb1fbb7590d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:14Z,use_quota=True,user_id='92c00aecbb964a9295713ff339b7ee1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08acedb2-69f1-400c-9cc9-a67003df63fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08acedb2-69f1-400c-9cc9-a67003df63fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d3de99-eccb-4106-b762-a6ace30f12b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d3de99-eccb-4106-b762-a6ace30f12b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa0ca9d1-b04e-413d-9efa-8019601af1e4', 'volume_name': 'volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8b550f-5d46-45a5-9a48-1e9ce05c6d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8b550f-5d46-45a5-9a48-1e9ce05c6d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b79fd-d536-4a37-bb0e-906acc793709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:14 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Volume aa0ca9d1-b04e-413d-9efa-8019601af1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4', 'volume_size': 1} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:14 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:14 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:14 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 0.655s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.687s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2091471962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0ca9d1-b04e-413d-9efa-8019601af1e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='040dd23611c84aeea7c3cb1fbb7590d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:14Z,use_quota=True,user_id='92c00aecbb964a9295713ff339b7ee1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Creating volume aa0ca9d1-b04e-413d-9efa-8019601af1e4 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:15 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:15 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 1073741824 Jun 27 04:34:15 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e600fc46-b4c8-4831-aaa6-b447d7470f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e2b792-662e-4fbb-b097-af69edff93d3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad1531-ebd0-4d6c-8c37-db6e0fe87bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Volume volume-a8e2b792-662e-4fbb-b097-af69edff93d3 (a8e2b792-662e-4fbb-b097-af69edff93d3): created successfully Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad1531-ebd0-4d6c-8c37-db6e0fe87bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (a65a8e13-2093-47d2-bac1-a7f212a54478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-109d319d-e76b-495b-905b-a295ef59a9ac tempest-VolumesSnapshotTestJSON-1814153431 None] Created volume successfully. Jun 27 04:34:15 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 1073741824" returned: 0 in 0.821s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:15 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 Jun 27 04:34:15 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:16 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4" returned: 0 in 0.708s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.163s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Creating offline snapshot 17f9ff99-439d-471d-804a-e608d3788721 of volume a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97b79fd-d536-4a37-bb0e-906acc793709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ee9b6d-7924-4172-99df-54870f76f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b4e65-5184-4b53-b3ae-078df5bf5c3b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:16 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Volume volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 (aa0ca9d1-b04e-413d-9efa-8019601af1e4): created successfully Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ee9b6d-7924-4172-99df-54870f76f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Flow 'volume_create_manager' (658bfbfd-95d7-4b4f-8667-b63dd1de0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3414e54c-09b8-4ae7-8843-3276fdbe5059 tempest-VolumesTestJSON-1527652726 None] Created volume successfully. Jun 27 04:34:16 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:16 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:17 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:17 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 1G Jun 27 04:34:17 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "cinder-aa0ca9d1-b04e-413d-9efa-8019601af1e4-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-aa0ca9d1-b04e-413d-9efa-8019601af1e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=65,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=7 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "cinder-quobyte-aa0ca9d1-b04e-413d-9efa-8019601af1e4" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-quobyte-aa0ca9d1-b04e-413d-9efa-8019601af1e4" acquired by "delete_volume" :: waited 0.032s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5395bbe8-bbe3-4271-92cf-bc3b662bb6f3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:18 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 Jun 27 04:34:18 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:18 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 1G" returned: 0 in 0.951s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e2b792-662e-4fbb-b097-af69edff93d3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:18 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e2b792-662e-4fbb-b097-af69edff93d3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 Jun 27 04:34:18 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:19 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4" returned: 0 in 0.819s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:19 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4 Jun 27 04:34:19 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:19 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e2b792-662e-4fbb-b097-af69edff93d3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721" returned: 0 in 0.731s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:19 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 is being set with open permissions: ugo+rw Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:19 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 Jun 27 04:34:19 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:19 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-aa0ca9d1-b04e-413d-9efa-8019601af1e4" returned: 0 in 0.675s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-quobyte-aa0ca9d1-b04e-413d-9efa-8019601af1e4" released by "delete_volume" :: held 1.541s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=60,cinder:INSERT=14,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:34:19 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721" returned: 0 in 0.671s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:19 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Created reservations ['53dc151c-068e-4d3d-9ca0-e713bca5004f', '8e8225f3-28c3-4710-8b57-846fe11a00f8', '2e8aedf2-6ad6-4d46-b0c8-b61524a21a8a', '9988bbc6-66a4-4fea-830e-78023fd57af0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:19 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:20 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:34:20 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "cinder-05f26109-5e06-44c0-8977-0edc6645d40f-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-05f26109-5e06-44c0-8977-0edc6645d40f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "cinder-quobyte-05f26109-5e06-44c0-8977-0edc6645d40f" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-quobyte-05f26109-5e06-44c0-8977-0edc6645d40f" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f395d0a-2325-46d5-a2e0-98340e6935fa]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:20 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:20 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:34:20 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info" returned: 0 in 0.826s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:20 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info is being set with open permissions: ugo+rw Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:20 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f Jun 27 04:34:20 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:20 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info Jun 27 04:34:20 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:20 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.864s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:34:20 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Deleted volume successfully. Jun 27 04:34:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2441d046-3b83-4a05-9440-15a989ccaf46 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-aa0ca9d1-b04e-413d-9efa-8019601af1e4-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:21 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.716s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:34:21 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.info" returned: 0 in 0.705s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.841s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:21 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f" returned: 0 in 0.830s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:21 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f Jun 27 04:34:21 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7c850703-0fee-4630-8525-3aea2c7de605 tempest-VolumesSnapshotTestJSON-1814153431 None] Create snapshot completed successfully Jun 27 04:34:22 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-05f26109-5e06-44c0-8977-0edc6645d40f" returned: 0 in 0.695s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-quobyte-05f26109-5e06-44c0-8977-0edc6645d40f" released by "delete_volume" :: held 1.592s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Created reservations ['e3e51623-c401-4366-a0ae-2d89dd54b190', '5549638d-c940-419c-a8c6-4c79a50926ef', '7e715bf4-9192-4264-8524-6509e7e59497', '15d0768b-c991-45fc-b815-28fdb2fd5047'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (6429f2d1-9b72-4252-9f9e-09a40f8adfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fc19b5-df2b-4545-adfa-19f364001dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fc19b5-df2b-4545-adfa-19f364001dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-19704632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3526bc-c9c4-474d-8b20-3be5834bed14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=17f9ff99-439d-471d-804a-e608d3788721,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:22Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc31e13-3352-4eae-b44d-2e10ad6b307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc31e13-3352-4eae-b44d-2e10ad6b307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ef8cfa-f486-4a93-8d87-962ce3ac4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ef8cfa-f486-4a93-8d87-962ce3ac4302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb3526bc-c9c4-474d-8b20-3be5834bed14', 'volume_name': 'volume-fb3526bc-c9c4-474d-8b20-3be5834bed14', 'volume_size': 2, 'snapshot_id': '17f9ff99-439d-471d-804a-e608d3788721'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77996eb4-114c-43dd-b59e-856a5b2691e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77996eb4-114c-43dd-b59e-856a5b2691e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0628b60-8b28-40a0-8194-6a1b4c86e323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:22 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Volume fb3526bc-c9c4-474d-8b20-3be5834bed14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb3526bc-c9c4-474d-8b20-3be5834bed14', 'volume_size': 2, 'snapshot_id': '17f9ff99-439d-471d-804a-e608d3788721'} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-17f9ff99-439d-471d-804a-e608d3788721-fb3526bc-c9c4-474d-8b20-3be5834bed14" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-17f9ff99-439d-471d-804a-e608d3788721-fb3526bc-c9c4-474d-8b20-3be5834bed14" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Creating volume fb3526bc-c9c4-474d-8b20-3be5834bed14 from snapshot 17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-fb3526bc-c9c4-474d-8b20-3be5834bed14" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-fb3526bc-c9c4-474d-8b20-3be5834bed14" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] snapshot: 17f9ff99-439d-471d-804a-e608d3788721, volume: fb3526bc-c9c4-474d-8b20-3be5834bed14, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:22 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:34:22 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d5a1d1-fce7-4c10-b2e2-d1ce70532cad]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:22 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 Jun 27 04:34:22 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "cinder-5fe1ffc6-57e9-4489-bcf1-4619eda8b992-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-5fe1ffc6-57e9-4489-bcf1-4619eda8b992-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "cinder-quobyte-5fe1ffc6-57e9-4489-bcf1-4619eda8b992" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-quobyte-5fe1ffc6-57e9-4489-bcf1-4619eda8b992" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de60c5b-a0b2-4c63-9433-2c72229d75f3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:23 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 Jun 27 04:34:23 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:23 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.750s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:34:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Deleted volume successfully. Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bf0ec5be-af81-4ad2-850f-9ebddeb51a67 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-05f26109-5e06-44c0-8977-0edc6645d40f-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:23 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721" returned: 0 in 0.912s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e2b792-662e-4fbb-b097-af69edff93d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a05f116-0f8a-4a4f-a24d-e54fb7795319]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:23 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:23 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:23 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992" returned: 0 in 0.892s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:23 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992 Jun 27 04:34:23 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:24 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 0.800s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:24 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 Jun 27 04:34:24 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:24 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fe1ffc6-57e9-4489-bcf1-4619eda8b992" returned: 0 in 0.692s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-quobyte-5fe1ffc6-57e9-4489-bcf1-4619eda8b992" released by "delete_volume" :: held 1.638s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Created reservations ['2141bfad-d6a9-4e4f-908e-1c485b8d41f2', '87fb8df4-8952-4e63-bf22-1cc8f96ba0ad', '7473ac10-b03b-4b03-86a4-80e0ff3a5d59', '6b8dac9c-1039-4577-b664-097c9236c782'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:24 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:34:24 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:25 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.930s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:25 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:34:25 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Deleted volume successfully. Jun 27 04:34:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29c747f7-5438-4729-85ed-a92367222924 tempest-VolumesTestJSON-1527652726 None] Lock "cinder-5fe1ffc6-57e9-4489-bcf1-4619eda8b992-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Flow 'volume_create_manager' (bd34591b-f19f-40d8-abf7-dce424dfbe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422e90aa-eb5b-4db2-abbc-a1a8fe65d1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422e90aa-eb5b-4db2-abbc-a1a8fe65d1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1776635660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d1110e-c4a8-4913-8b2b-01799ede659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e49ad54eb4e98aa0b092b74b72913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:27Z,use_quota=True,user_id='bdd2585709e94c038eef11ebb442b76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5386711e-0248-44cd-b800-024478100f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5386711e-0248-44cd-b800-024478100f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1242a9a-772c-4fbd-afb5-787b3d53676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1242a9a-772c-4fbd-afb5-787b3d53676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d1110e-c4a8-4913-8b2b-01799ede659f', 'volume_name': 'volume-54d1110e-c4a8-4913-8b2b-01799ede659f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aebd949-7e45-4fd0-a894-c4e0d90a0791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aebd949-7e45-4fd0-a894-c4e0d90a0791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d290a7-2b3e-4dde-8bc0-e937487a3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:27 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Volume 54d1110e-c4a8-4913-8b2b-01799ede659f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d1110e-c4a8-4913-8b2b-01799ede659f', 'volume_size': 1} Jun 27 04:34:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:30 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14" returned: 0 in 6.467s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e725585-562f-418f-bcf3-734008f86df8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:30 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:30 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:31 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 1.038s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:31 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:34:31 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Converted 1024.00 MB image at 158.33 MB/s Jun 27 04:34:31 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 is being set with open permissions: ugo+rw Jun 27 04:34:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:31 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 Jun 27 04:34:31 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:32 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14" returned: 0 in 0.679s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-fb3526bc-c9c4-474d-8b20-3be5834bed14" released by "_copy_volume_from_snapshot" :: held 10.035s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-17f9ff99-439d-471d-804a-e608d3788721-fb3526bc-c9c4-474d-8b20-3be5834bed14" released by "_create_volume_from_snapshot" :: held 10.079s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.111s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.033s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1776635660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d1110e-c4a8-4913-8b2b-01799ede659f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877e49ad54eb4e98aa0b092b74b72913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:27Z,use_quota=True,user_id='bdd2585709e94c038eef11ebb442b76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Creating volume 54d1110e-c4a8-4913-8b2b-01799ede659f {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:32 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:32 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f 1073741824 Jun 27 04:34:32 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0628b60-8b28-40a0-8194-6a1b4c86e323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3526bc-c9c4-474d-8b20-3be5834bed14', 'volume_size': 2, 'snapshot_id': '17f9ff99-439d-471d-804a-e608d3788721'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbe084d-224c-4417-8d77-f3bd3f2b8b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Volume volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 (fb3526bc-c9c4-474d-8b20-3be5834bed14): created successfully Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbe084d-224c-4417-8d77-f3bd3f2b8b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (6429f2d1-9b72-4252-9f9e-09a40f8adfff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-03a34790-0490-43d5-8bef-b8a70a358f4c tempest-VolumesSnapshotTestJSON-1814153431 None] Created volume successfully. Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-fb3526bc-c9c4-474d-8b20-3be5834bed14-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-fb3526bc-c9c4-474d-8b20-3be5834bed14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-fb3526bc-c9c4-474d-8b20-3be5834bed14" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-fb3526bc-c9c4-474d-8b20-3be5834bed14" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb7e817-2d15-403c-b1de-f1b28a2f9160]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:33 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 Jun 27 04:34:33 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:33 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f 1073741824" returned: 0 in 1.492s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:34 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f Jun 27 04:34:34 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:34 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14" returned: 0 in 1.080s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:34 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14 Jun 27 04:34:34 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:34 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f" returned: 0 in 0.937s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.499s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d290a7-2b3e-4dde-8bc0-e937487a3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d1110e-c4a8-4913-8b2b-01799ede659f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c0c0ef-6c72-4c3f-9acd-7e710cda949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:35 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Volume volume-54d1110e-c4a8-4913-8b2b-01799ede659f (54d1110e-c4a8-4913-8b2b-01799ede659f): created successfully Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c0c0ef-6c72-4c3f-9acd-7e710cda949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Flow 'volume_create_manager' (bd34591b-f19f-40d8-abf7-dce424dfbe58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a0e399fb-32a0-46b4-a69d-e6ba2d419192 tempest-AttachVolumeShelveTestJSON-165205586 None] Created volume successfully. Jun 27 04:34:35 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fb3526bc-c9c4-474d-8b20-3be5834bed14" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-fb3526bc-c9c4-474d-8b20-3be5834bed14" released by "delete_volume" :: held 1.934s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['909ba1c7-55e8-478d-aa9b-f215bf267517', '9534992e-e354-4c74-b207-54e29df9df99', 'f11af6de-194d-4d32-9638-b2edcea77754', 'fafb8d3c-3ae0-4e15-af39-82c270fabdbb'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:35 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:34:35 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-17f9ff99-439d-471d-804a-e608d3788721-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-17f9ff99-439d-471d-804a-e608d3788721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-a8e2b792-662e-4fbb-b097-af69edff93d3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-a8e2b792-662e-4fbb-b097-af69edff93d3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-17f9ff99-439d-471d-804a-e608d3788721" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-17f9ff99-439d-471d-804a-e608d3788721" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleting offline snapshot 17f9ff99-439d-471d-804a-e608d3788721 of volume a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] snapshot_file for this snap is: volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ffeee-fed4-4f16-9423-ac485c9cf87c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:36 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 Jun 27 04:34:36 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:36 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.052s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:34:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleted volume successfully. Jun 27 04:34:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9c8c3b74-bef7-4fd7-b83a-76b73bd70218 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-fb3526bc-c9c4-474d-8b20-3be5834bed14-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:37 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721" returned: 0 in 1.173s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e2b792-662e-4fbb-b097-af69edff93d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:34:37 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[405e0a56-7b6c-44f9-b62b-d836014cb5c4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:37 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:37 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:38 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 0.901s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:38 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 Jun 27 04:34:38 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:39 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721" returned: 0 in 0.892s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:39 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721 Jun 27 04:34:39 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Flow 'volume_create_manager' (e8b400d6-1d9a-44af-a918-e8d43105d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a068610a-8704-46f6-b572-35ff2a088a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:40 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a068610a-8704-46f6-b572-35ff2a088a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1935653113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2325c9ea-f8a4-4390-8e47-05fa7cb585f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f84f84114024a95ae92c08d4fce643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:40Z,use_quota=True,user_id='6b9a5642687e41909db7efcc05cdd8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f63bacc-9f1a-4fb6-b595-b14b2d5f7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f63bacc-9f1a-4fb6-b595-b14b2d5f7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3aa0bb2-392c-49c2-8032-4912489dc376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3aa0bb2-392c-49c2-8032-4912489dc376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2325c9ea-f8a4-4390-8e47-05fa7cb585f3', 'volume_name': 'volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc850621-f609-4161-a562-a9fe23a7683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc850621-f609-4161-a562-a9fe23a7683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507c7d02-a6f0-4e95-82d2-9ac709020608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:40 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3', 'volume_size': 1} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1935653113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2325c9ea-f8a4-4390-8e47-05fa7cb585f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f84f84114024a95ae92c08d4fce643b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:40Z,use_quota=True,user_id='6b9a5642687e41909db7efcc05cdd8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Creating volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:40 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3.17f9ff99-439d-471d-804a-e608d3788721" returned: 0 in 1.170s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:40 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 1073741824 Jun 27 04:34:40 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-17f9ff99-439d-471d-804a-e608d3788721" released by "_delete_snapshot" :: held 4.312s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-a8e2b792-662e-4fbb-b097-af69edff93d3" released by "delete_snapshot" :: held 4.350s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['e2eaaa1f-3c38-4ce7-87d3-b9e8e9094392', 'fe389480-58cb-4496-888b-f3ac093b426a', '991dba71-8f27-4b08-a592-d38ac0c405d0', 'dc410ed3-1853-464e-9f45-82e4becd1163'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:40 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Delete snapshot completed successfully. Jun 27 04:34:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c40bd9b1-402f-416c-9f94-a5e3281c8b06 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-17f9ff99-439d-471d-804a-e608d3788721-delete_snapshot" released by "delete_snapshot" :: held 4.530s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:41 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 1073741824" returned: 0 in 1.031s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:41 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 Jun 27 04:34:41 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-a8e2b792-662e-4fbb-b097-af69edff93d3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-a8e2b792-662e-4fbb-b097-af69edff93d3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-a8e2b792-662e-4fbb-b097-af69edff93d3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-a8e2b792-662e-4fbb-b097-af69edff93d3" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ee208-089d-46c9-9db8-f11e1e4141a7]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:41 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:41 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:42 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" returned: 0 in 0.889s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507c7d02-a6f0-4e95-82d2-9ac709020608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc728bd-569c-4c45-b12e-b7b0b55792dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:42 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Volume volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 (2325c9ea-f8a4-4390-8e47-05fa7cb585f3): created successfully Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc728bd-569c-4c45-b12e-b7b0b55792dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Flow 'volume_create_manager' (e8b400d6-1d9a-44af-a918-e8d43105d065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:42 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-be8eb4d4-1f80-43b6-bf10-33f8523d37b3 tempest-SnapshotsActionsTest-1771638992 None] Created volume successfully. Jun 27 04:34:42 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 0.904s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:42 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3 Jun 27 04:34:42 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:42 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-207bca71-2063-4f4e-9940-21815f325edd req-36c5ad82-c6bb-43c5-8ccd-f85c9ff800c9 tempest-AttachVolumeNegativeTest-966199752 None] Terminate volume connection completed successfully. Jun 27 04:34:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-207bca71-2063-4f4e-9940-21815f325edd req-36c5ad82-c6bb-43c5-8ccd-f85c9ff800c9 tempest-AttachVolumeNegativeTest-966199752 None] Deleting attachment 982212aa-352f-4b68-bf10-8b1bcfb70c35. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:34:43 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a8e2b792-662e-4fbb-b097-af69edff93d3" returned: 0 in 0.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-a8e2b792-662e-4fbb-b097-af69edff93d3" released by "delete_volume" :: held 1.758s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['24b44ba3-e3c1-4a41-b0cf-293086e5f5f3', '064a2e6f-947f-489d-b990-37da4f8b8e18', 'fd072f52-009f-48b3-9a29-05773c90cb70', '73862fa0-e04c-4dd9-8638-fc899a61b97e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:43 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:34:43 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Creating offline snapshot 67eeb234-bc3d-4f61-bb81-373337a42ecb of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a03fb0f-0c26-4336-b11a-ddb9b6ac717d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:43 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 Jun 27 04:34:43 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:44 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.917s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:34:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleted volume successfully. Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-45c65dc5-c7e0-4bd4-b3fb-7394b326b992 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-a8e2b792-662e-4fbb-b097-af69edff93d3-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (4b28cefa-3fdf-435a-978c-a65043c6fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a778d7-c7b0-4b63-83a1-0ec392bafd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a778d7-c7b0-4b63-83a1-0ec392bafd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-438926608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deafd231-9442-4544-9c48-d95f0d1a14a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:44Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94169d5a-2c78-4379-9ff9-8a864643cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94169d5a-2c78-4379-9ff9-8a864643cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238e7ffc-872b-44c5-83e8-bd21d9fa0041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238e7ffc-872b-44c5-83e8-bd21d9fa0041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deafd231-9442-4544-9c48-d95f0d1a14a2', 'volume_name': 'volume-deafd231-9442-4544-9c48-d95f0d1a14a2', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43c35c-879c-4904-ae6e-cc3b8af04f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd43c35c-879c-4904-ae6e-cc3b8af04f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6881f354-aa2e-4afb-9df8-0ccd0d995e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:44 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Volume deafd231-9442-4544-9c48-d95f0d1a14a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deafd231-9442-4544-9c48-d95f0d1a14a2', 'volume_size': 1} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:44 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" returned: 0 in 1.069s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:44 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb 1G Jun 27 04:34:44 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:46 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb 1G" returned: 0 in 1.136s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:46 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:34:46 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:47 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.985s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:47 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb is being set with open permissions: ugo+rw Jun 27 04:34:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:47 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:34:47 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:47 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.678s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:47 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info Jun 27 04:34:47 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:48 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info" returned: 0 in 0.754s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:48 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info is being set with open permissions: ugo+rw Jun 27 04:34:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:48 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info Jun 27 04:34:48 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:49 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.info" returned: 0 in 0.687s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.446s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.610s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-438926608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deafd231-9442-4544-9c48-d95f0d1a14a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:34:44Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Creating volume deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:34:49 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:34:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:49 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 1073741824 Jun 27 04:34:49 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e25a2e65-1b90-42c7-b82c-3bc7ced2c22b tempest-SnapshotsActionsTest-1771638992 None] Create snapshot completed successfully Jun 27 04:34:50 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 1073741824" returned: 0 in 1.057s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:50 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:34:50 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:51 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 0.682s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.418s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Creating offline snapshot a5abb6cd-4072-47b9-8c1b-46ebdf864818 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6881f354-aa2e-4afb-9df8-0ccd0d995e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deafd231-9442-4544-9c48-d95f0d1a14a2', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281d3859-793d-4ce8-8a23-18fbc16fcc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3441b80-238a-4c3e-a8e5-38d435227d1d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:51 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Volume volume-deafd231-9442-4544-9c48-d95f0d1a14a2 (deafd231-9442-4544-9c48-d95f0d1a14a2): created successfully Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281d3859-793d-4ce8-8a23-18fbc16fcc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:34:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (4b28cefa-3fdf-435a-978c-a65043c6fe22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:34:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-64fde850-29e4-4d2a-a7d2-4489198e0f2d tempest-VolumesSnapshotTestJSON-1814153431 None] Created volume successfully. Jun 27 04:34:51 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:34:51 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:52 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.928s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:34:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:52 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 1G Jun 27 04:34:52 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:34:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-1da2c49c-71dc-431d-adae-fda9ede3a985 req-1a3691be-abb3-4e56-8205-6895658398f5 tempest-AttachVolumeShelveTestJSON-165205586 None] No connector for attachment 8c557b35-2c7c-44b9-8e28-e642ad688a9e; skipping storage backend terminate_connection call. {{(pid=93772) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 27 04:34:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-1da2c49c-71dc-431d-adae-fda9ede3a985 req-1a3691be-abb3-4e56-8205-6895658398f5 tempest-AttachVolumeShelveTestJSON-165205586 None] Deleting attachment 8c557b35-2c7c-44b9-8e28-e642ad688a9e. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:34:53 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 1G" returned: 0 in 1.056s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:53 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 Jun 27 04:34:53 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818" returned: 0 in 0.844s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:53 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 is being set with open permissions: ugo+rw Jun 27 04:34:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:53 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:53 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 Jun 27 04:34:53 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:54 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818" returned: 0 in 0.775s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.715s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.555s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:34:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Creating offline snapshot da7c59f1-3b28-4620-8028-db0546387bb6 of volume deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:34:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-430a179d-2a7e-409c-93f7-73cf3bee73de tempest-SnapshotsActionsTest-1771638992 None] Create snapshot completed successfully Jun 27 04:34:54 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25f004-379f-4719-828d-95140e2dec28]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:54 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:34:54 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:55 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 0.922s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:55 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 1G Jun 27 04:34:55 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-a5abb6cd-4072-47b9-8c1b-46ebdf864818-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-a5abb6cd-4072-47b9-8c1b-46ebdf864818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-a5abb6cd-4072-47b9-8c1b-46ebdf864818" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-a5abb6cd-4072-47b9-8c1b-46ebdf864818" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Deleting offline snapshot a5abb6cd-4072-47b9-8c1b-46ebdf864818 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] snapshot_file for this snap is: volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8f01c-7852-4f99-84b9-1c993c8255bc]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:56 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 Jun 27 04:34:56 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:56 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 1G" returned: 0 in 1.020s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deafd231-9442-4544-9c48-d95f0d1a14a2 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:56 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deafd231-9442-4544-9c48-d95f0d1a14a2 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 Jun 27 04:34:56 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:57 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818" returned: 0 in 0.975s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc472d45-033f-4900-928f-032de2ffdadc]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:57 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:34:57 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:57 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deafd231-9442-4544-9c48-d95f0d1a14a2 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6" returned: 0 in 0.821s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:57 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 is being set with open permissions: ugo+rw Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:57 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 Jun 27 04:34:57 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:57 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.878s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:34:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:57 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 Jun 27 04:34:57 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:58 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6" returned: 0 in 0.804s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:58 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info Jun 27 04:34:58 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:58 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818" returned: 0 in 0.907s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:58 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818 Jun 27 04:34:58 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:59 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info" returned: 0 in 0.733s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:59 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info is being set with open permissions: ugo+rw Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:34:59 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info Jun 27 04:34:59 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:34:59 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.a5abb6cd-4072-47b9-8c1b-46ebdf864818" returned: 0 in 0.747s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-a5abb6cd-4072-47b9-8c1b-46ebdf864818" released by "_delete_snapshot" :: held 3.625s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" released by "delete_snapshot" :: held 3.653s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Created reservations ['e581c94b-ba33-4f5a-bde7-24612bb4eb18', '373e9538-2ccb-402a-a127-fed4c7290cfb', 'da646be1-2552-46cc-b14c-12dd6d502562', 'f85b7348-690e-4d59-b9cd-87f9dfe71b05'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:34:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Delete snapshot completed successfully. Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-90d2f775-0abe-4264-935b-0114a7db5117 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-a5abb6cd-4072-47b9-8c1b-46ebdf864818-delete_snapshot" released by "delete_snapshot" :: held 3.819s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:34:59 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.info" returned: 0 in 0.699s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:34:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.106s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:34:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4864794f-bfee-4497-9d7e-764c5a115224 tempest-VolumesSnapshotTestJSON-1814153431 None] Create snapshot completed successfully Jun 27 04:35:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Creating offline snapshot 7a0828dd-aece-4645-8b22-023e43940b03 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:35:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa592cb-a02e-469f-949e-8f237cc74c41]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:00 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:00 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (24ac8d7e-206a-4e10-ab92-097f3e534ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaded96-73a4-474d-a81b-bb1936e10d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaded96-73a4-474d-a81b-bb1936e10d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1059124765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05345b76d15f416aa27bb43528e3cd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da7c59f1-3b28-4620-8028-db0546387bb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:35:01Z,use_quota=True,user_id='40b610af0adc480f89808c9983c52da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192c0e41-4bc6-4ceb-9dbf-543c12c1967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192c0e41-4bc6-4ceb-9dbf-543c12c1967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd86a3ca-e05d-4add-a000-f933e01d92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd86a3ca-e05d-4add-a000-f933e01d92ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd2dd02b7-aed4-430e-a7e5-df7abd7aa7a7', 'volume_name': 'volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7', 'volume_size': 1, 'snapshot_id': 'da7c59f1-3b28-4620-8028-db0546387bb6'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f281fc71-b907-49a3-a8cc-997bf2f43a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f281fc71-b907-49a3-a8cc-997bf2f43a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df3a14-e0d6-4bf1-9f2d-ccd9dbdc2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Volume d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7', 'volume_size': 1, 'snapshot_id': 'da7c59f1-3b28-4620-8028-db0546387bb6'} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:01 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 1.026s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:01 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 1G Jun 27 04:35:01 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:02 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 1G" returned: 0 in 0.969s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:02 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 Jun 27 04:35:02 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:03 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03" returned: 0 in 0.872s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:03 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 is being set with open permissions: ugo+rw Jun 27 04:35:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:03 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 Jun 27 04:35:03 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:04 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03" returned: 0 in 0.865s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.877s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.856s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-da7c59f1-3b28-4620-8028-db0546387bb6-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-da7c59f1-3b28-4620-8028-db0546387bb6-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Creating volume d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 from snapshot da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:04 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-169396ec-d585-49c3-b36c-36895c8f28a3 tempest-SnapshotsActionsTest-1771638992 None] Create snapshot completed successfully Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] snapshot: da7c59f1-3b28-4620-8028-db0546387bb6, volume: d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d856a4f-752f-4a65-a029-e4b506f1810e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:04 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 Jun 27 04:35:04 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-7a0828dd-aece-4645-8b22-023e43940b03-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-7a0828dd-aece-4645-8b22-023e43940b03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-7a0828dd-aece-4645-8b22-023e43940b03" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-7a0828dd-aece-4645-8b22-023e43940b03" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Deleting offline snapshot 7a0828dd-aece-4645-8b22-023e43940b03 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] snapshot_file for this snap is: volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c648d8-cc4a-43bf-8524-5119f0ed1695]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:05 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 Jun 27 04:35:05 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:06 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6" returned: 0 in 1.850s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deafd231-9442-4544-9c48-d95f0d1a14a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8ee9d5-2cdb-49a6-aac1-cd463d6ef33e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:06 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:35:06 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:06 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03" returned: 0 in 1.499s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c31737-84fb-4196-b749-a96b72e85531]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:06 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:06 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:07 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 1.100s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:07 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:35:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:07 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.916s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:07 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 Jun 27 04:35:07 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:07 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 Jun 27 04:35:07 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:09 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03" returned: 0 in 1.361s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:09 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03 Jun 27 04:35:09 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:10 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.7a0828dd-aece-4645-8b22-023e43940b03" returned: 0 in 1.374s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-7a0828dd-aece-4645-8b22-023e43940b03" released by "_delete_snapshot" :: held 5.410s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" released by "delete_snapshot" :: held 5.467s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:10 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Created reservations ['c4ebfc8b-caf8-4247-a0a9-d665e9d81805', 'fea9fe66-ec6a-447b-b6f1-12a35c1fc9a1', 'ecc95cf6-58ef-43b1-aa7f-7087b1fb6301', 'd296052b-8775-4d9f-9cfd-adbdfa3debba'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Delete snapshot completed successfully. Jun 27 04:35:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0939399e-b1a7-4957-82d3-390d7d53fd66 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-7a0828dd-aece-4645-8b22-023e43940b03-delete_snapshot" released by "delete_snapshot" :: held 6.074s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:15 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" returned: 0 in 7.562s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[862632f7-e194-4ab5-8d12-bcfc34ea835f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:15 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:35:15 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:16 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 1.614s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:16 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:35:16 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Converted 1024.00 MB image at 135.40 MB/s Jun 27 04:35:16 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 is being set with open permissions: ugo+rw Jun 27 04:35:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:16 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 Jun 27 04:35:16 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:18 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" returned: 0 in 1.130s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" released by "_copy_volume_from_snapshot" :: held 13.483s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-da7c59f1-3b28-4620-8028-db0546387bb6-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" released by "_create_volume_from_snapshot" :: held 13.551s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.600s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.566s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Creating offline snapshot 86b16607-c548-4ff2-b432-0621e8388be8 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db199d6-d367-4158-b024-b5ef498d6121]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df3a14-e0d6-4bf1-9f2d-ccd9dbdc2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7', 'volume_size': 1, 'snapshot_id': 'da7c59f1-3b28-4620-8028-db0546387bb6'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2788d228-03b6-45e0-a673-d8d5d59313e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=65,cinder:UPDATE=77,cinder:INSERT=18,cinder:DELETE=7 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:35:18 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Volume volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 (d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7): created successfully Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2788d228-03b6-45e0-a673-d8d5d59313e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Flow 'volume_create_manager' (24ac8d7e-206a-4e10-ab92-097f3e534ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:35:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-21f0bf9a-a93a-4dde-846e-53e7759bcc70 tempest-VolumesSnapshotTestJSON-1814153431 None] Created volume successfully. Jun 27 04:35:18 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:18 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f219b6f-d8bc-4f47-a1bc-cdabac16a51a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:19 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 Jun 27 04:35:19 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:19 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 1.555s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:19 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 1G Jun 27 04:35:19 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:20 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" returned: 0 in 1.130s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:20 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7 Jun 27 04:35:20 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:20 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:35:20 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:21 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" returned: 0 in 1.110s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7" released by "delete_volume" :: held 2.344s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:21 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:INSERT=20,cinder:UPDATE=75,cinder:SELECT=69,cinder:DELETE=8 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:35:21 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 1G" returned: 0 in 2.041s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:21 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 Jun 27 04:35:21 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:21 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['7d35e106-0e71-4b64-812d-16edb5e0e4b7', '64c9451d-bcdc-4bc2-9a92-b8dbc5af6ded', 'c2cdeef3-67c7-4f10-8fad-0d87c6a302ad', 'd9437577-6401-418b-911b-ef775746223c'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:22 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.399s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:22 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:35:22 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-da7c59f1-3b28-4620-8028-db0546387bb6-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-da7c59f1-3b28-4620-8028-db0546387bb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-deafd231-9442-4544-9c48-d95f0d1a14a2" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-deafd231-9442-4544-9c48-d95f0d1a14a2" acquired by "delete_snapshot" :: waited 0.068s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-da7c59f1-3b28-4620-8028-db0546387bb6" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-da7c59f1-3b28-4620-8028-db0546387bb6" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleting offline snapshot da7c59f1-3b28-4620-8028-db0546387bb6 of volume deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] snapshot_file for this snap is: volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51393a-220c-4cb9-80c7-5e5463765b7b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:23 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.050s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:35:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Deleted volume successfully. Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee3a271a-7b64-43fc-a796-426b44f5932d tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-d2dd02b7-aed4-430e-a7e5-df7abd7aa7a7-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:23 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8" returned: 0 in 1.534s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:23 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 is being set with open permissions: ugo+rw Jun 27 04:35:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:23 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 Jun 27 04:35:23 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:23 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 Jun 27 04:35:23 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:24 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8" returned: 0 in 0.827s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.120s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e791089c-303c-4fad-879d-4e2923628cd0 tempest-SnapshotsActionsTest-1771638992 None] Create snapshot completed successfully Jun 27 04:35:24 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6" returned: 0 in 1.183s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deafd231-9442-4544-9c48-d95f0d1a14a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[be846a31-77f9-48df-8ee3-ced6cd3639cb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:24 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:35:24 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:25 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 0.830s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:25 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 Jun 27 04:35:25 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-86b16607-c548-4ff2-b432-0621e8388be8-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-86b16607-c548-4ff2-b432-0621e8388be8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-86b16607-c548-4ff2-b432-0621e8388be8" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-86b16607-c548-4ff2-b432-0621e8388be8" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Deleting offline snapshot 86b16607-c548-4ff2-b432-0621e8388be8 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] snapshot_file for this snap is: volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad11ec82-2500-4eed-bd43-72a4694affee]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:25 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 Jun 27 04:35:25 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:26 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6" returned: 0 in 0.929s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:26 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6 Jun 27 04:35:26 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:26 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8" returned: 0 in 0.951s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f72b23-70cc-45df-a24b-b69f4b0e972f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:26 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:26 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:26 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2.da7c59f1-3b28-4620-8028-db0546387bb6" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-da7c59f1-3b28-4620-8028-db0546387bb6" released by "_delete_snapshot" :: held 3.925s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-deafd231-9442-4544-9c48-d95f0d1a14a2" released by "delete_snapshot" :: held 3.983s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['fbdec536-1025-48da-8d2e-1c65f98517d7', '5ed8b5cf-d020-4a02-a197-b839761c67d8', '05735c39-bfaa-4aff-9d27-c2f0960eb4ba', '22871e55-268d-48da-b14a-67e2b6d66f10'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Delete snapshot completed successfully. Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f1db4d80-ef4e-4428-8088-094fa01db829 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-da7c59f1-3b28-4620-8028-db0546387bb6-delete_snapshot" released by "delete_snapshot" :: held 4.316s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-deafd231-9442-4544-9c48-d95f0d1a14a2-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-deafd231-9442-4544-9c48-d95f0d1a14a2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-deafd231-9442-4544-9c48-d95f0d1a14a2" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-deafd231-9442-4544-9c48-d95f0d1a14a2" acquired by "delete_volume" :: waited 0.037s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bca5a-1bd7-4ec4-914d-9b87a3b582ea]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:27 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.971s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:27 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 Jun 27 04:35:27 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:27 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:35:27 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:28 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 0.909s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:28 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2 Jun 27 04:35:28 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:28 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8" returned: 0 in 1.021s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:28 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8 Jun 27 04:35:28 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:29 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-deafd231-9442-4544-9c48-d95f0d1a14a2" returned: 0 in 0.713s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-deafd231-9442-4544-9c48-d95f0d1a14a2" released by "delete_volume" :: held 1.682s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['78c2e241-6eca-440a-87ad-6344226dca4c', '8840b9bc-5f14-410a-a99b-82aca61a27b5', '11624e30-ea1b-4ea1-82e6-b0bd43e2a27c', 'f969ca06-ae42-4ba8-a974-5245948f1e67'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:29 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:35:29 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:29 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.86b16607-c548-4ff2-b432-0621e8388be8" returned: 0 in 0.919s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-86b16607-c548-4ff2-b432-0621e8388be8" released by "_delete_snapshot" :: held 3.978s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" released by "delete_snapshot" :: held 4.024s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Created reservations ['9ab09366-38ca-4f78-ad80-8a599425b78a', 'bbcc171b-375e-45ac-9eb9-60c1f7509a80', '25f5ed3b-5726-4fff-9a8f-20d5f0d02655', '3e07f26f-1c56-49f4-afd8-9c2151e019d0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Delete snapshot completed successfully. Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b34e75df-8b08-49aa-bb89-b8be1ccd2e65 tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-86b16607-c548-4ff2-b432-0621e8388be8-delete_snapshot" released by "delete_snapshot" :: held 4.308s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-60392495-fef3-4a06-b025-6f9202338987-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-60392495-fef3-4a06-b025-6f9202338987-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "cinder-quobyte-60392495-fef3-4a06-b025-6f9202338987" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-60392495-fef3-4a06-b025-6f9202338987" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb931f-dbf5-43c5-9ad3-18848a7ea194]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:30 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.943s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:35:30 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleted volume successfully. Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-31aaaf7f-fcea-487b-b0b9-87ffcaa1fb90 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-deafd231-9442-4544-9c48-d95f0d1a14a2-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:30 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 Jun 27 04:35:30 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Creating offline snapshot af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbee30dc-777f-46d3-b874-2d9b4f30a265]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:30 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:30 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:31 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987" returned: 0 in 1.094s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:31 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987 Jun 27 04:35:31 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:31 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.913s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:31 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 1G Jun 27 04:35:31 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:32 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-60392495-fef3-4a06-b025-6f9202338987" returned: 0 in 0.855s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-quobyte-60392495-fef3-4a06-b025-6f9202338987" released by "delete_volume" :: held 2.068s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Created reservations ['fcd898e0-9c31-4895-833a-dad2f12c479b', 'b492244d-bcfd-4012-8d2c-bf7120bba1fa', 'd1a0ea75-c780-4f39-b917-c1f9f55022dd', '7226a4db-ecd5-4c2e-b4a0-aa26f9e193af'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:32 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:35:32 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:32 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 1G" returned: 0 in 1.065s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:32 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 Jun 27 04:35:32 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:32 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.670s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:32 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:35:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Deleted volume successfully. Jun 27 04:35:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-064194e2-1100-493f-9793-27f9a1c3eb63 tempest-VolumesSnapshotTestJSON-1814153431 None] Lock "cinder-60392495-fef3-4a06-b025-6f9202338987-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:33 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" returned: 0 in 0.668s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:33 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 is being set with open permissions: ugo+rw Jun 27 04:35:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:33 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 Jun 27 04:35:33 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:33 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" returned: 0 in 0.626s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:33 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-206bb151-08c2-463b-89ce-c26d259bcbef tempest-SnapshotsActionsTest-1771638992 None] Create snapshot completed successfully Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Acquiring lock "cinder-quobyte-af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Deleting offline snapshot af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] snapshot_file for this snap is: volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce83cfb4-7d79-456a-bc38-29f923a15c08]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:34 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 Jun 27 04:35:34 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:35 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" returned: 0 in 0.799s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8979189-f12b-4c6f-a680-876775185049]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:35 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:35 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:36 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.846s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:36 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 Jun 27 04:35:36 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:37 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" returned: 0 in 0.882s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:37 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4 Jun 27 04:35:37 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:38 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" returned: 0 in 0.676s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4" released by "_delete_snapshot" :: held 3.310s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" released by "delete_snapshot" :: held 3.337s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:38 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Created reservations ['18dac360-ee1e-4160-a9df-dd38dec94df1', 'bb39f11b-4749-4415-a177-ae9e316ee3ba', '3ad400a3-de42-4059-aa15-d9f01a9ccd93', '9aeb61c4-7af4-4d7b-9d36-c53b9a787a82'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Delete snapshot completed successfully. Jun 27 04:35:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a9a94c16-6107-4e02-8ef2-cf5a7695ef0b tempest-SnapshotsActionsTest-1120958576 None] Lock "cinder-af6ed1e1-e8a9-4f09-8e14-6d23f93b54c4-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Flow 'volume_create_manager' (d63f7675-fac9-4f08-8274-05a859c3910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e1437d-4705-49a0-a041-c718be36a54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "cinder-67eeb234-bc3d-4f61-bb81-373337a42ecb-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e1437d-4705-49a0-a041-c718be36a54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-798789086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151bdd38-e56d-4490-8e79-098a2d6a8452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1b5a17c8af45b0b4d189c50e4cc294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:35:40Z,use_quota=True,user_id='fe240bdec2e3456cbbe1339f803e44b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3d2057-bdd2-4f5b-94fd-1be2902284c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3d2057-bdd2-4f5b-94fd-1be2902284c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e25676b-d943-4538-875c-d2dbf2a5c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e25676b-d943-4538-875c-d2dbf2a5c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151bdd38-e56d-4490-8e79-098a2d6a8452', 'volume_name': 'volume-151bdd38-e56d-4490-8e79-098a2d6a8452', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaa1c89-258d-4181-96aa-f888e1e95a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaa1c89-258d-4181-96aa-f888e1e95a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aaa4d42-4751-423d-a73e-a8218d27879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:39 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Volume 151bdd38-e56d-4490-8e79-098a2d6a8452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151bdd38-e56d-4490-8e79-098a2d6a8452', 'volume_size': 1} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-798789086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151bdd38-e56d-4490-8e79-098a2d6a8452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1b5a17c8af45b0b4d189c50e4cc294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:35:40Z,use_quota=True,user_id='fe240bdec2e3456cbbe1339f803e44b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Creating volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:35:39 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-67eeb234-bc3d-4f61-bb81-373337a42ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.107s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:39 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 1073741824 Jun 27 04:35:39 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "cinder-quobyte-67eeb234-bc3d-4f61-bb81-373337a42ecb" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-quobyte-67eeb234-bc3d-4f61-bb81-373337a42ecb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Deleting offline snapshot 67eeb234-bc3d-4f61-bb81-373337a42ecb of volume 2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] snapshot_file for this snap is: volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ae6096-8b8e-4b94-8800-a92568b2aa17]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:40 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:40 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:40 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 1073741824" returned: 0 in 0.887s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:40 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 Jun 27 04:35:40 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:40 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.844s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5ea8fb-e5f7-4cc4-b18d-5be77eab2a08]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:41 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 Jun 27 04:35:41 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:42 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452" returned: 0 in 1.442s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aaa4d42-4751-423d-a73e-a8218d27879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151bdd38-e56d-4490-8e79-098a2d6a8452', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41988058-0478-45c4-99e3-638bc11faf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:42 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Volume volume-151bdd38-e56d-4490-8e79-098a2d6a8452 (151bdd38-e56d-4490-8e79-098a2d6a8452): created successfully Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41988058-0478-45c4-99e3-638bc11faf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Flow 'volume_create_manager' (d63f7675-fac9-4f08-8274-05a859c3910d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:35:42 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d82e0593-ffe8-4ce5-ab44-0f2c365bf35c tempest-VolumesSnapshotListTestJSON-2036680096 None] Created volume successfully. Jun 27 04:35:42 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" returned: 0 in 1.447s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:42 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:42 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:43 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 1.078s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:43 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb Jun 27 04:35:43 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Flow 'volume_create_manager' (98e2a8f5-2699-43e2-9c9b-a7f827b11448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e54a1b-314e-47ca-92cf-c732498a535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Creating offline snapshot 9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f of volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e54a1b-314e-47ca-92cf-c732498a535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881591718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16c78d1-21b7-486a-a0c1-11bb288b88fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21fb517f2f40a395a73f9535998073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:35:43Z,use_quota=True,user_id='e66eb9bd25b241aeb8f18d8b3d6b684e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ee5779-8e5a-4ad1-bfd2-fd9e8fdbeb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ee5779-8e5a-4ad1-bfd2-fd9e8fdbeb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6adc87e-ab41-47d6-a5f1-0d13c408224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6adc87e-ab41-47d6-a5f1-0d13c408224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c16c78d1-21b7-486a-a0c1-11bb288b88fa', 'volume_name': 'volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5b8102-6aa6-4e44-8a1e-3b25e0358959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5b8102-6aa6-4e44-8a1e-3b25e0358959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e788b9d3-0769-4453-9d75-f1a123a3eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:43 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Volume c16c78d1-21b7-486a-a0c1-11bb288b88fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa', 'volume_size': 1} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f82344-76b4-4790-8f49-cf3b79528993]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:43 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 Jun 27 04:35:43 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:44 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3.67eeb234-bc3d-4f61-bb81-373337a42ecb" returned: 0 in 0.691s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-quobyte-67eeb234-bc3d-4f61-bb81-373337a42ecb" released by "_delete_snapshot" :: held 4.334s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" released by "delete_snapshot" :: held 4.365s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Created reservations ['46fe9787-2db3-4bb7-bdc1-d6ef58845e13', 'fa905b7e-3e51-469d-b13e-2988898d0ca6', 'd20009d2-987f-4a4e-9430-6960849b1e28', 'c785abbc-f547-4961-9e2f-bf06700e6c28'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Delete snapshot completed successfully. Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-275b187b-71fc-489c-8aa8-8e198e22b63c tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-67eeb234-bc3d-4f61-bb81-373337a42ecb-delete_snapshot" released by "delete_snapshot" :: held 4.639s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:44 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452" returned: 0 in 1.022s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:44 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f 1G Jun 27 04:35:44 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "cinder-2325c9ea-f8a4-4390-8e47-05fa7cb585f3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-2325c9ea-f8a4-4390-8e47-05fa7cb585f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:45 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f 1G" returned: 0 in 0.874s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f685ce1-e5c4-460d-b13e-5d855a494615]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:45 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:35:45 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:45 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 Jun 27 04:35:45 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:46 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 0.699s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:46 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f is being set with open permissions: ugo+rw Jun 27 04:35:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:46 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:35:46 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:46 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" returned: 0 in 0.777s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:46 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3 Jun 27 04:35:46 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:46 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 0.638s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:46 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info Jun 27 04:35:46 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:47 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" returned: 0 in 0.683s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-quobyte-2325c9ea-f8a4-4390-8e47-05fa7cb585f3" released by "delete_volume" :: held 1.559s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Created reservations ['1b9b3c98-8ae1-47de-a6c4-6fb56e4ec39f', '1fedc526-9963-4f36-bc6c-86cc5dff1eaf', 'a7525eca-0947-4bf5-b340-0485ee2a3e14', '7b34e934-99d9-4bae-b0ab-7b110c4712c8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:47 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:35:47 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:47 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info" returned: 0 in 0.640s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:47 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info is being set with open permissions: ugo+rw Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:47 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info Jun 27 04:35:47 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:47 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.746s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:35:47 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Deleted volume successfully. Jun 27 04:35:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0471c34-bfce-4cd1-ad44-128e324f3b3f tempest-SnapshotsActionsTest-1771638992 None] Lock "cinder-2325c9ea-f8a4-4390-8e47-05fa7cb585f3-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:48 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.info" returned: 0 in 0.826s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.887s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.779s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881591718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c16c78d1-21b7-486a-a0c1-11bb288b88fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21fb517f2f40a395a73f9535998073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:35:43Z,use_quota=True,user_id='e66eb9bd25b241aeb8f18d8b3d6b684e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Creating volume c16c78d1-21b7-486a-a0c1-11bb288b88fa {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:35:48 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:35:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:48 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa 1073741824 Jun 27 04:35:48 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9acba096-1584-425d-8e8e-48124397deb3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Create snapshot completed successfully Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Acquiring lock "cinder-54d1110e-c4a8-4913-8b2b-01799ede659f-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "cinder-54d1110e-c4a8-4913-8b2b-01799ede659f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Acquiring lock "cinder-quobyte-54d1110e-c4a8-4913-8b2b-01799ede659f" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "cinder-quobyte-54d1110e-c4a8-4913-8b2b-01799ede659f" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c81416-62a5-4e8b-96dd-25f7f73cc16b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:49 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f Jun 27 04:35:49 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:49 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa 1073741824" returned: 0 in 1.155s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:49 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa Jun 27 04:35:49 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:50 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f" returned: 0 in 0.913s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:50 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f Jun 27 04:35:50 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:50 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa" returned: 0 in 0.744s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.340s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e788b9d3-0769-4453-9d75-f1a123a3eb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fb20e2-4474-4f60-b7ed-f3e02f0e706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Creating offline snapshot fe1a94fd-01ef-4963-b971-0cbf7967a3f9 of volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:35:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Volume volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa (c16c78d1-21b7-486a-a0c1-11bb288b88fa): created successfully Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fb20e2-4474-4f60-b7ed-f3e02f0e706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Flow 'volume_create_manager' (98e2a8f5-2699-43e2-9c9b-a7f827b11448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbf75ba-d54b-433c-8404-9f79736f4c98]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-47c9f2ae-e37b-4d8c-9bd7-64b9cffa17e5 tempest-AttachVolumeNegativeTest-966199752 None] Created volume successfully. Jun 27 04:35:50 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:35:50 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:51 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-54d1110e-c4a8-4913-8b2b-01799ede659f" returned: 0 in 0.795s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "cinder-quobyte-54d1110e-c4a8-4913-8b2b-01799ede659f" released by "delete_volume" :: held 1.780s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Created reservations ['6d38d489-060a-4bb4-95b1-8f5d6bd3cd32', '5374c269-b52f-47e7-8e6d-6b8a0cd91e6d', 'da94117a-f932-423c-8a64-ff0821446f8f', '0cd42e46-1947-441a-a605-e8b661dcc62b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:51 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:35:51 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:51 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 1.013s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:51 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 1G Jun 27 04:35:51 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:52 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.795s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:52 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:35:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Deleted volume successfully. Jun 27 04:35:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4d718349-0e44-4a2e-b5f6-9c001d4615bb tempest-AttachVolumeShelveTestJSON-165205586 None] Lock "cinder-54d1110e-c4a8-4913-8b2b-01799ede659f-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:35:52 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 1G" returned: 0 in 1.024s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:52 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:35:52 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:53 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 0.910s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:53 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 is being set with open permissions: ugo+rw Jun 27 04:35:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:53 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:35:53 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:54 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 0.731s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.811s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.091s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ca549-5c24-4b81-a4b2-a253212aeca8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-05ea9a2e-9298-497b-bdf6-7b5bf31b3fd3 tempest-VolumesSnapshotListTestJSON-2036680096 None] Create snapshot completed successfully Jun 27 04:35:54 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa Jun 27 04:35:54 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:35:55 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa" returned: 0 in 1.091s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.115s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.340s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Creating offline snapshot 15167893-7d53-4178-b302-6544a01b8ffb of volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5c503d-c45d-4b35-b00b-7e7d85acb4fd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '828a4a01-9a42-4f8f-bcc4-0631cb4ef4b3', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:35:55 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-4037fed0-fef4-4975-8580-55db93480045 req-b88eb937-e939-4a24-85f1-62befcb5cc84 tempest-AttachVolumeNegativeTest-966199752 None] attachment_update completed successfully. Jun 27 04:35:55 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:35:55 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:56 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 1.126s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:35:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:56 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb 1G Jun 27 04:35:56 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:57 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb 1G" returned: 0 in 1.210s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:57 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb Jun 27 04:35:57 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:58 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb" returned: 0 in 0.828s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:58 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb is being set with open permissions: ugo+rw Jun 27 04:35:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:35:58 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb Jun 27 04:35:58 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:35:59 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jun 27 04:35:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb" returned: 0 in 0.722s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:35:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.044s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:35:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b5806ec7-896e-441b-b9d5-2da52c98604a tempest-VolumesSnapshotListTestJSON-2036680096 None] Create snapshot completed successfully Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-15167893-7d53-4178-b302-6544a01b8ffb-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-15167893-7d53-4178-b302-6544a01b8ffb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-15167893-7d53-4178-b302-6544a01b8ffb" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-15167893-7d53-4178-b302-6544a01b8ffb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Deleting offline snapshot 15167893-7d53-4178-b302-6544a01b8ffb of volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] snapshot_file for this snap is: volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab6e62-c034-444e-b4a4-2e16294358c9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:01 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb Jun 27 04:36:01 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:02 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb" returned: 0 in 1.014s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:36:02 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d91992-4a34-4e4e-a9c9-a363130ead1e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:02 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:36:02 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-78b1d912-7e4a-4e20-9508-cac81dbf4031 req-d2ac2ba8-3f6d-4870-86e2-2c18cd68190a tempest-AttachVolumeNegativeTest-966199752 None] Terminate volume connection completed successfully. Jun 27 04:36:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-78b1d912-7e4a-4e20-9508-cac81dbf4031 req-d2ac2ba8-3f6d-4870-86e2-2c18cd68190a tempest-AttachVolumeNegativeTest-966199752 None] Deleting attachment 828a4a01-9a42-4f8f-bcc4-0631cb4ef4b3. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:36:03 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 0.975s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:36:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:03 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb Jun 27 04:36:03 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:04 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb" returned: 0 in 0.964s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:04 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb Jun 27 04:36:04 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:05 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.15167893-7d53-4178-b302-6544a01b8ffb" returned: 0 in 0.998s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-15167893-7d53-4178-b302-6544a01b8ffb" released by "_delete_snapshot" :: held 4.082s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" released by "delete_snapshot" :: held 4.107s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:05 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Created reservations ['5435aa3c-395e-4550-813a-df95d76180e3', '12c489cb-bbb8-4cd1-8df4-be18fb7f0b06', 'f4809e6d-68b0-4fb8-b5c4-4c881e6a07de', '7756c802-4cd7-4f29-aa30-d0e8dfdc92b3'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Delete snapshot completed successfully. Jun 27 04:36:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e28835e1-cc5f-43e7-974e-8a45a955e781 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-15167893-7d53-4178-b302-6544a01b8ffb-delete_snapshot" released by "delete_snapshot" :: held 4.275s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-fe1a94fd-01ef-4963-b971-0cbf7967a3f9-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-fe1a94fd-01ef-4963-b971-0cbf7967a3f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-fe1a94fd-01ef-4963-b971-0cbf7967a3f9" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-fe1a94fd-01ef-4963-b971-0cbf7967a3f9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Deleting offline snapshot fe1a94fd-01ef-4963-b971-0cbf7967a3f9 of volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] snapshot_file for this snap is: volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93af10-fb9d-4224-978b-a4667ca3ae68]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:07 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:36:07 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:08 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 1.367s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:36:08 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2739cb-9bb0-4029-9064-d64d683419aa]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:08 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:36:08 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:09 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 1.078s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:36:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:09 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:36:09 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:10 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 1.165s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:10 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9 Jun 27 04:36:10 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:11 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.fe1a94fd-01ef-4963-b971-0cbf7967a3f9" returned: 0 in 0.744s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-fe1a94fd-01ef-4963-b971-0cbf7967a3f9" released by "_delete_snapshot" :: held 4.548s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" released by "delete_snapshot" :: held 4.583s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:11 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Created reservations ['c0f1c5f6-446d-460b-bf33-32f097a9c478', 'd3f43d50-f493-46c8-b7a2-3656c29d9aa0', '86e6c574-5328-4bca-a048-54a9c2795cf8', 'c79af59e-6360-453a-a465-8a31d88446b1'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Delete snapshot completed successfully. Jun 27 04:36:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-38c54b98-6719-4d5c-95bc-7c27ba87d05d tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-fe1a94fd-01ef-4963-b971-0cbf7967a3f9-delete_snapshot" released by "delete_snapshot" :: held 4.837s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Deleting offline snapshot 9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f of volume 151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] snapshot_file for this snap is: volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b167d2b-86d6-4a13-b4ef-e6ae495daa55]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:12 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:36:12 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:13 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 0.899s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151bdd38-e56d-4490-8e79-098a2d6a8452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:36:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3db8ae-0c6c-4407-80c1-25529593f365]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:13 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 Jun 27 04:36:13 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:14 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452" returned: 0 in 0.904s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:14 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:36:14 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:15 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 0.987s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:15 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f Jun 27 04:36:15 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:15 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452.9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" returned: 0 in 0.779s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f" released by "_delete_snapshot" :: held 3.734s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" released by "delete_snapshot" :: held 3.767s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Created reservations ['df520ec4-a6b3-492f-84ba-a85f0584fe0e', 'c3094518-a1a7-449f-a31d-a1a527c51086', '2fdd826d-9b2f-4b63-b884-25b49ce7f572', 'a87a686e-cb9c-4d05-9087-fef469609c47'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Delete snapshot completed successfully. Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4e1229a-9e32-44c1-adef-e58b3d9ff3c0 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-9bbcf2a6-cc3d-4fdf-9602-7b05504ac32f-delete_snapshot" released by "delete_snapshot" :: held 4.011s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-151bdd38-e56d-4490-8e79-098a2d6a8452-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-151bdd38-e56d-4490-8e79-098a2d6a8452-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d58a241-d142-4e87-bda6-4886ce346cbc]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:16 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 Jun 27 04:36:16 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:17 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452" returned: 0 in 1.017s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:17 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452 Jun 27 04:36:17 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:18 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-151bdd38-e56d-4490-8e79-098a2d6a8452" returned: 0 in 0.962s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-quobyte-151bdd38-e56d-4490-8e79-098a2d6a8452" released by "delete_volume" :: held 2.067s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=81,cinder:INSERT=20,cinder:UPDATE=100,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Created reservations ['54d7126f-e1c6-4541-b6cc-75eae728b158', 'c7f6c8a1-22a2-4b14-9b12-21c47bdb5b6d', '6c505bbf-6830-456f-b8d9-1e4453534d61', '038d4695-e8c9-4db3-a36c-891bbdbe6434'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:18 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:36:18 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:19 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.865s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:19 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:36:19 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Deleted volume successfully. Jun 27 04:36:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b5961f3e-512f-4a11-a810-eb607b961318 tempest-VolumesSnapshotListTestJSON-2036680096 None] Lock "cinder-151bdd38-e56d-4490-8e79-098a2d6a8452-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:20 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:36:20 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Flow 'volume_create_manager' (06877184-b1e7-45de-b9bc-e47414701092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e03260-9776-472e-a02a-d23703bc4725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e03260-9776-472e-a02a-d23703bc4725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1235589586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1aff56b-038f-4003-899a-921b9655e1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2501a6af6c1d42d2a87f72ad44c8c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:21Z,use_quota=True,user_id='7944c4a71cd04ba5bd6942df0df17ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1999ee-126b-4209-8bc6-1d8eda4c076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1999ee-126b-4209-8bc6-1d8eda4c076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecf0de0-3bc5-4603-89e9-cd13d216812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecf0de0-3bc5-4603-89e9-cd13d216812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1aff56b-038f-4003-899a-921b9655e1dc', 'volume_name': 'volume-f1aff56b-038f-4003-899a-921b9655e1dc', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e36151-4eb7-46e5-b061-e41cea406a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e36151-4eb7-46e5-b061-e41cea406a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e367f367-e9f3-44a9-a2b0-47106db64fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:21 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Volume f1aff56b-038f-4003-899a-921b9655e1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1aff56b-038f-4003-899a-921b9655e1dc', 'volume_size': 1} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1235589586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1aff56b-038f-4003-899a-921b9655e1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2501a6af6c1d42d2a87f72ad44c8c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:21Z,use_quota=True,user_id='7944c4a71cd04ba5bd6942df0df17ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Creating volume f1aff56b-038f-4003-899a-921b9655e1dc {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:36:21 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:21 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc 1073741824 Jun 27 04:36:21 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:21 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.954s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:36:22 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc 1073741824" returned: 0 in 1.125s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:22 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=91,cinder:INSERT=33,cinder:UPDATE=95,cinder:DELETE=7 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:36:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:22 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc Jun 27 04:36:22 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:23 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e367f367-e9f3-44a9-a2b0-47106db64fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1aff56b-038f-4003-899a-921b9655e1dc', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69129ff1-a1cf-4ed0-948d-d712b475cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:23 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Volume volume-f1aff56b-038f-4003-899a-921b9655e1dc (f1aff56b-038f-4003-899a-921b9655e1dc): created successfully Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69129ff1-a1cf-4ed0-948d-d712b475cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Flow 'volume_create_manager' (06877184-b1e7-45de-b9bc-e47414701092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-79d9156f-420f-4ad7-ac46-5a340869d350 tempest-VolumesTransfersTest-1122089285 None] Created volume successfully. Jun 27 04:36:25 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8b4faca2-d3e9-4923-a293-4596514323b5 tempest-VolumesTransfersTest-1858725274 None] Transfer volume completed successfully. Jun 27 04:36:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Acquiring lock "cinder-f1aff56b-038f-4003-899a-921b9655e1dc-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-f1aff56b-038f-4003-899a-921b9655e1dc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Acquiring lock "cinder-quobyte-f1aff56b-038f-4003-899a-921b9655e1dc" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-quobyte-f1aff56b-038f-4003-899a-921b9655e1dc" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:26 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ecd1eb-6b0f-4911-8426-9ec143071186]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:26 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc Jun 27 04:36:26 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:27 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc" returned: 0 in 1.026s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:27 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc Jun 27 04:36:27 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:28 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f1aff56b-038f-4003-899a-921b9655e1dc" returned: 0 in 0.895s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-quobyte-f1aff56b-038f-4003-899a-921b9655e1dc" released by "delete_volume" :: held 1.984s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Created reservations ['e473089e-d7bd-4b33-a7a2-b5803a34c514', '4ff3edfd-2b6c-4b07-a25e-85dcab89dc01', 'd92cddeb-6762-41a4-9e10-07884149c0c7', 'c21503d0-fd5d-41fe-9891-2555dac791a7'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:28 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:36:28 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:29 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.686s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:29 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:36:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Deleted volume successfully. Jun 27 04:36:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e258136a-26a5-4686-ae5c-02dd1e679004 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-f1aff56b-038f-4003-899a-921b9655e1dc-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Flow 'volume_create_manager' (d0760672-8e21-4e3f-9acd-81ffe9cf86af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04545ba1-c708-4056-9aa9-ad611381cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04545ba1-c708-4056-9aa9-ad611381cf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-532406286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8ea95e-89d9-4f24-a891-e60ea71b4b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2501a6af6c1d42d2a87f72ad44c8c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:30Z,use_quota=True,user_id='7944c4a71cd04ba5bd6942df0df17ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52ad09b-2ee4-4b73-a1c0-a889110d7ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52ad09b-2ee4-4b73-a1c0-a889110d7ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551be23b-b734-4c62-94de-927e9d371c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551be23b-b734-4c62-94de-927e9d371c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8ea95e-89d9-4f24-a891-e60ea71b4b58', 'volume_name': 'volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14a9518-69c7-4a4f-b9c0-7e65fb2cb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14a9518-69c7-4a4f-b9c0-7e65fb2cb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3334d4ca-954a-4caa-a35b-135cd5377818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:30 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Volume fa8ea95e-89d9-4f24-a891-e60ea71b4b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58', 'volume_size': 1} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-532406286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8ea95e-89d9-4f24-a891-e60ea71b4b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2501a6af6c1d42d2a87f72ad44c8c7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:30Z,use_quota=True,user_id='7944c4a71cd04ba5bd6942df0df17ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Creating volume fa8ea95e-89d9-4f24-a891-e60ea71b4b58 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:36:30 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:36:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:30 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 1073741824 Jun 27 04:36:30 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:31 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 1073741824" returned: 0 in 1.032s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:31 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 Jun 27 04:36:31 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:32 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58" returned: 0 in 0.860s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3334d4ca-954a-4caa-a35b-135cd5377818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7716d9b6-2bf9-4714-abc0-7f2ded162beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Volume volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 (fa8ea95e-89d9-4f24-a891-e60ea71b4b58): created successfully Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7716d9b6-2bf9-4714-abc0-7f2ded162beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Flow 'volume_create_manager' (d0760672-8e21-4e3f-9acd-81ffe9cf86af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5a3e8d43-dca1-4bed-9ee7-9369ece8ce78 tempest-VolumesTransfersTest-1122089285 None] Created volume successfully. Jun 27 04:36:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Acquiring lock "cinder-fa8ea95e-89d9-4f24-a891-e60ea71b4b58-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-fa8ea95e-89d9-4f24-a891-e60ea71b4b58-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Acquiring lock "cinder-quobyte-fa8ea95e-89d9-4f24-a891-e60ea71b4b58" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-quobyte-fa8ea95e-89d9-4f24-a891-e60ea71b4b58" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:34 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e0feba-7dd5-41b3-83e3-696ed245b97c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:35 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 Jun 27 04:36:35 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:37 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58" returned: 0 in 2.366s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:37 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58 Jun 27 04:36:37 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:38 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-fa8ea95e-89d9-4f24-a891-e60ea71b4b58" returned: 0 in 1.280s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-quobyte-fa8ea95e-89d9-4f24-a891-e60ea71b4b58" released by "delete_volume" :: held 3.726s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Created reservations ['14ea7859-7dea-4a99-9fc8-a441d8734897', '0ece25c9-bb91-408a-a06f-c1075fd2bbf9', 'cf9e9f52-cbf6-49e1-a403-79336da51621', '3a5d9717-76cc-4277-a8e1-5445e170e429'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:38 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:36:38 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:39 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.880s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:39 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:36:39 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Deleted volume successfully. Jun 27 04:36:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-7d243c02-38cb-4c0c-823b-ab06301bf233 tempest-VolumesTransfersTest-386126775 None] Lock "cinder-fa8ea95e-89d9-4f24-a891-e60ea71b4b58-delete_volume" released by "delete_volume" :: held 4.945s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:48 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=21,cinder:DELETE=3,cinder:SELECT=12,cinder:INSERT=4 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:36:49 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (deca7d87-5782-48b0-ad14-3852dbb79319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed9abaf-05bc-4753-bd92-ed0f198682b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed9abaf-05bc-4753-bd92-ed0f198682b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2114218523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a639b236-6b54-49df-ad17-3227b61a1e70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:50Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e14e225-3d75-41fd-94e6-a79feb1cb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e14e225-3d75-41fd-94e6-a79feb1cb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff0cd15-9f4d-454c-84cd-68cda171be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff0cd15-9f4d-454c-84cd-68cda171be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a639b236-6b54-49df-ad17-3227b61a1e70', 'volume_name': 'volume-a639b236-6b54-49df-ad17-3227b61a1e70', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f43e51-62da-4436-914d-42184e84bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f43e51-62da-4436-914d-42184e84bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bdfeb4-cd78-4b9c-8b72-79618d615f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Volume a639b236-6b54-49df-ad17-3227b61a1e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a639b236-6b54-49df-ad17-3227b61a1e70', 'volume_size': 1} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2114218523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a639b236-6b54-49df-ad17-3227b61a1e70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:50Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Creating volume a639b236-6b54-49df-ad17-3227b61a1e70 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:36:50 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:36:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:50 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 1073741824 Jun 27 04:36:50 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:51 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 1073741824" returned: 0 in 1.150s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:51 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 Jun 27 04:36:51 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:52 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70" returned: 0 in 1.238s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.455s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bdfeb4-cd78-4b9c-8b72-79618d615f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a639b236-6b54-49df-ad17-3227b61a1e70', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1058df-0586-49b1-a925-5f97b234ecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Volume volume-a639b236-6b54-49df-ad17-3227b61a1e70 (a639b236-6b54-49df-ad17-3227b61a1e70): created successfully Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1058df-0586-49b1-a925-5f97b234ecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (deca7d87-5782-48b0-ad14-3852dbb79319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-748b28a0-3e6b-4761-a2ad-353fafff0043 tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (2b4c8d2d-df5f-4266-8302-1516449b74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87e35b8-b3b7-4da8-8507-6fea7eb76c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87e35b8-b3b7-4da8-8507-6fea7eb76c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-818097694',display_name='tempest-VolumesGetTest-Volume-1254384840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f465021f-4164-431e-825f-6554aaea70d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:54Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30efdda2-33ed-42dd-bd71-78499862a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30efdda2-33ed-42dd-bd71-78499862a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad42e180-1a99-4797-a9f8-d80e1bcdb688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad42e180-1a99-4797-a9f8-d80e1bcdb688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f465021f-4164-431e-825f-6554aaea70d1', 'volume_name': 'volume-f465021f-4164-431e-825f-6554aaea70d1', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d21406-2500-47d0-9c21-1f29c460f503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d21406-2500-47d0-9c21-1f29c460f503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bfcd51-1fb3-49ef-85d6-c4fb839cebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Volume f465021f-4164-431e-825f-6554aaea70d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f465021f-4164-431e-825f-6554aaea70d1', 'volume_size': 1} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:36:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-818097694',display_name='tempest-VolumesGetTest-Volume-1254384840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f465021f-4164-431e-825f-6554aaea70d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:36:54Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Creating volume f465021f-4164-431e-825f-6554aaea70d1 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:36:54 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:36:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:54 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 1073741824 Jun 27 04:36:54 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:55 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 1073741824" returned: 0 in 1.344s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:56 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 Jun 27 04:36:56 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:56 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1" returned: 0 in 0.898s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bfcd51-1fb3-49ef-85d6-c4fb839cebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f465021f-4164-431e-825f-6554aaea70d1', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9f0fec-f853-4c9f-a753-6a7a72aceb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:36:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Volume volume-f465021f-4164-431e-825f-6554aaea70d1 (f465021f-4164-431e-825f-6554aaea70d1): created successfully Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9f0fec-f853-4c9f-a753-6a7a72aceb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:36:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (2b4c8d2d-df5f-4266-8302-1516449b74ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:36:57 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-afe5af00-0aa4-482b-8e26-26764997af82 tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:36:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-f465021f-4164-431e-825f-6554aaea70d1-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Lock "cinder-f465021f-4164-431e-825f-6554aaea70d1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-f465021f-4164-431e-825f-6554aaea70d1" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:36:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-f465021f-4164-431e-825f-6554aaea70d1" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:36:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb247980-71c0-471e-80fb-eebd6d6bace5]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:36:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:58 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 Jun 27 04:36:58 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:58 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1" returned: 0 in 0.924s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:59 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1 Jun 27 04:36:59 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:36:59 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f465021f-4164-431e-825f-6554aaea70d1" returned: 0 in 0.773s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-f465021f-4164-431e-825f-6554aaea70d1" released by "delete_volume" :: held 1.766s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Created reservations ['18a1d842-b231-4c73-8b1d-c21c7aadb0be', '6d52bf73-fe8e-474c-9cb9-dea64cb3f644', '5c8f9c99-34c6-4d88-adc4-4bac1ea7c352', 'eef62967-354a-4183-a4eb-3c832d177b69'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:36:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:36:59 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:36:59 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-a639b236-6b54-49df-ad17-3227b61a1e70-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Lock "cinder-a639b236-6b54-49df-ad17-3227b61a1e70-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-a639b236-6b54-49df-ad17-3227b61a1e70" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-a639b236-6b54-49df-ad17-3227b61a1e70" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbb83e2-ceab-4768-92a0-e13be37d9a0f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Flow 'volume_create_manager' (79590c07-b728-41fb-98a4-31b8f37973f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193408b7-f8ce-44d6-a006-f6a2983faff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:00 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 Jun 27 04:37:00 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193408b7-f8ce-44d6-a006-f6a2983faff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-287571940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c031475f-9126-4c38-a377-fa3cf7284f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525981eb02664f4ca7fc479f086f6841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:00Z,use_quota=True,user_id='5ac248781eb64a209ab8bf418a745239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a282ea3-619d-4cc5-b269-c54555b208b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a282ea3-619d-4cc5-b269-c54555b208b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618d2af3-418c-4b1e-93f7-aa8e3e9f610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618d2af3-418c-4b1e-93f7-aa8e3e9f610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c031475f-9126-4c38-a377-fa3cf7284f35', 'volume_name': 'volume-c031475f-9126-4c38-a377-fa3cf7284f35', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe0341-1290-42b5-b86b-35ee5a8d1e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe0341-1290-42b5-b86b-35ee5a8d1e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5ae7ce-9fb1-4a71-ac50-8030ddc8990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:00 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Volume c031475f-9126-4c38-a377-fa3cf7284f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c031475f-9126-4c38-a377-fa3cf7284f35', 'volume_size': 1} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-287571940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c031475f-9126-4c38-a377-fa3cf7284f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525981eb02664f4ca7fc479f086f6841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:00Z,use_quota=True,user_id='5ac248781eb64a209ab8bf418a745239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Creating volume c031475f-9126-4c38-a377-fa3cf7284f35 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:00 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:00 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 1073741824 Jun 27 04:37:00 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:00 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.770s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:37:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c4f7a194-7eb0-4675-8a33-40b1b7aa84e4 tempest-VolumesGetTest-850357168 None] Lock "cinder-f465021f-4164-431e-825f-6554aaea70d1-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:01 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70" returned: 0 in 0.831s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:01 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70 Jun 27 04:37:01 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:01 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 1073741824" returned: 0 in 0.987s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:01 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 Jun 27 04:37:01 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:01 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a639b236-6b54-49df-ad17-3227b61a1e70" returned: 0 in 0.753s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-a639b236-6b54-49df-ad17-3227b61a1e70" released by "delete_volume" :: held 1.649s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Created reservations ['b8a28781-cee1-4e45-88ea-8db28b6a7e89', 'e42eed46-bde3-418a-89c8-77ecb78de0f6', 'd596b6d3-d76e-43f1-9753-4f2aaecfeae6', 'fe925fda-5463-4311-93ec-4be498a5c645'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:02 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:02 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:02 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35" returned: 0 in 0.724s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5ae7ce-9fb1-4a71-ac50-8030ddc8990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c031475f-9126-4c38-a377-fa3cf7284f35', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf97087-04a9-496e-9afa-4317651785d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:02 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Volume volume-c031475f-9126-4c38-a377-fa3cf7284f35 (c031475f-9126-4c38-a377-fa3cf7284f35): created successfully Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf97087-04a9-496e-9afa-4317651785d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Flow 'volume_create_manager' (79590c07-b728-41fb-98a4-31b8f37973f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-eb9b5eac-3d55-49ad-a168-4c52728b46a2 tempest-AttachVolumeTestJSON-1319297077 None] Created volume successfully. Jun 27 04:37:02 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.713s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f0a9bc6-170b-4302-8df7-5c57f688c651 tempest-VolumesGetTest-850357168 None] Lock "cinder-a639b236-6b54-49df-ad17-3227b61a1e70-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (9739866a-48a9-47bf-b8c2-4a2540cdb908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b2fd60-4c96-4af8-9f44-6c62bac40ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b2fd60-4c96-4af8-9f44-6c62bac40ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-823270160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b41ac3b-a5b5-45e3-b696-26448d3fde81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:03Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb557a1a-e7c1-487f-9020-f9bbed7c2b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb557a1a-e7c1-487f-9020-f9bbed7c2b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d1f0a9-4db7-4b2f-810c-f066727ae337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d1f0a9-4db7-4b2f-810c-f066727ae337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'volume_name': 'volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649f598f-3fbc-454b-b48e-21301cb98642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649f598f-3fbc-454b-b48e-21301cb98642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3d98e0-d7ba-404b-b4d2-7af7e378a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:03 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Volume 4b41ac3b-a5b5-45e3-b696-26448d3fde81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'volume_size': 1} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-823270160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b41ac3b-a5b5-45e3-b696-26448d3fde81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:03Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Creating volume 4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:03 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:03 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 1073741824 Jun 27 04:37:03 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:04 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 1073741824" returned: 0 in 1.061s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:04 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:04 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:05 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 0.958s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3d98e0-d7ba-404b-b4d2-7af7e378a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c192b67-56fa-43cc-8676-47e94ac987dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:05 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Volume volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 (4b41ac3b-a5b5-45e3-b696-26448d3fde81): created successfully Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c192b67-56fa-43cc-8676-47e94ac987dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (9739866a-48a9-47bf-b8c2-4a2540cdb908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2e2b0976-2fb2-49d0-88d2-4608f12ef5ae tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[15741dc1-7eb3-4bbf-8a6c-0905f0d95f80]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:05 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 Jun 27 04:37:05 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (054321c9-b097-41ed-a7dd-884d25ea28cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882e764c-ae9e-412c-b8d0-24c94540970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882e764c-ae9e-412c-b8d0-24c94540970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-612270124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1304c163-d29a-4af9-8340-f004d62e5b77,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4b41ac3b-a5b5-45e3-b696-26448d3fde81,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:07Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41dfe5f7-c9a7-4163-99a2-ea36831b4d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41dfe5f7-c9a7-4163-99a2-ea36831b4d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7884ce85-7eac-42d1-b351-db4e03184985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:06 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35" returned: 0 in 1.097s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.126s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7884ce85-7eac-42d1-b351-db4e03184985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1304c163-d29a-4af9-8340-f004d62e5b77', 'volume_name': 'volume-1304c163-d29a-4af9-8340-f004d62e5b77', 'volume_size': 1, 'source_volid': '4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'source_volstatus': 'available'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e796b4-e4e9-45ae-ba8f-575ed4aa46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e796b4-e4e9-45ae-ba8f-575ed4aa46e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf4916f-705f-4620-a833-25524ef08ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:06 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Volume 1304c163-d29a-4af9-8340-f004d62e5b77: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1304c163-d29a-4af9-8340-f004d62e5b77', 'volume_size': 1, 'source_volid': '4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'source_volstatus': 'available'} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:06 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Cloning volume 4b41ac3b-a5b5-45e3-b696-26448d3fde81 to volume 1304c163-d29a-4af9-8340-f004d62e5b77 Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-c031475f-9126-4c38-a377-fa3cf7284f35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40896e00-406d-4d03-b710-386bd1e725b3', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:37:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Creating offline snapshot 251ca51c-17f8-4089-b75f-463815cd9e15 of volume 4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:37:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcda7f7-e855-4116-ba27-97b5cc37b7dd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-242ccb0c-ff72-4583-baf6-0ef1cb63c6ae req-109b19e9-d486-41d6-b765-c5bf9ae65c66 tempest-AttachVolumeTestJSON-1319297077 None] attachment_update completed successfully. Jun 27 04:37:07 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:07 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:07 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 0.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:07 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 1G Jun 27 04:37:07 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:08 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 1G" returned: 0 in 0.948s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:08 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 Jun 27 04:37:08 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:09 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15" returned: 0 in 0.732s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:09 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 is being set with open permissions: ugo+rw Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:09 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 Jun 27 04:37:09 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Flow 'volume_create_manager' (6be2daca-1eb8-4da8-b570-8b5809d6eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f6c765-461f-419f-a7e9-351f66358ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f6c765-461f-419f-a7e9-351f66358ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1014082213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47b6fce-5008-4f20-997f-20f970d4fcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21fb517f2f40a395a73f9535998073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:10Z,use_quota=True,user_id='e66eb9bd25b241aeb8f18d8b3d6b684e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a04cf26-c8b3-4c43-911f-35c7a1064015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a04cf26-c8b3-4c43-911f-35c7a1064015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d18aae6-992e-4eb7-a0e7-8c2e39a18bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d18aae6-992e-4eb7-a0e7-8c2e39a18bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47b6fce-5008-4f20-997f-20f970d4fcca', 'volume_name': 'volume-c47b6fce-5008-4f20-997f-20f970d4fcca', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241ba8a2-a98a-43db-bd80-50c6c929020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241ba8a2-a98a-43db-bd80-50c6c929020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c19d07-5f9d-43c0-b15a-8f8bc2f49576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:10 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Volume c47b6fce-5008-4f20-997f-20f970d4fcca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47b6fce-5008-4f20-997f-20f970d4fcca', 'volume_size': 1} Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:10 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15" returned: 0 in 0.694s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:10 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info Jun 27 04:37:10 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:10 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info" returned: 0 in 0.715s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:10 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info is being set with open permissions: ugo+rw Jun 27 04:37:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:10 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info Jun 27 04:37:10 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:11 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.info" returned: 0 in 0.718s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-1304c163-d29a-4af9-8340-f004d62e5b77" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-1304c163-d29a-4af9-8340-f004d62e5b77" acquired by "_copy_volume_from_snapshot" :: waited 0.070s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] snapshot: 251ca51c-17f8-4089-b75f-463815cd9e15, volume: 1304c163-d29a-4af9-8340-f004d62e5b77, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b33a59-bf41-465e-a042-7024884a75c0]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:12 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 Jun 27 04:37:12 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:13 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15" returned: 0 in 1.368s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:37:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:37:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:37:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[29de07c1-5504-4e7f-94bc-66eaa1ee56bd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:13 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:13 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:14 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 1.121s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:14 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:37:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:14 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 Jun 27 04:37:14 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=35,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=8 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=22,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:20 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:20 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:22 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77" returned: 0 in 7.724s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1857e-39bc-4832-8b30-3e49c27fde6c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:22 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:22 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:22 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.832s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:23 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 1.104s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:23 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:37:23 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Converted 1024.00 MB image at 132.47 MB/s Jun 27 04:37:23 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 is being set with open permissions: ugo+rw Jun 27 04:37:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:23 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 Jun 27 04:37:23 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:23 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77" returned: 0 in 0.651s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-1304c163-d29a-4af9-8340-f004d62e5b77" released by "_copy_volume_from_snapshot" :: held 12.180s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-251ca51c-17f8-4089-b75f-463815cd9e15" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-251ca51c-17f8-4089-b75f-463815cd9e15" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Deleting offline snapshot 251ca51c-17f8-4089-b75f-463815cd9e15 of volume 4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] snapshot_file for this snap is: volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be7a2d-7664-4312-bf89-1930dd23dedd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:24 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 Jun 27 04:37:24 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:24 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15" returned: 0 in 0.727s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b77df9d-d6a1-413e-9516-16a346c10e66]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:24 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:24 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:25 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 0.885s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:25 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 Jun 27 04:37:25 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:26 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15" returned: 0 in 0.722s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:26 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15 Jun 27 04:37:26 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:27 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81.251ca51c-17f8-4089-b75f-463815cd9e15" returned: 0 in 0.747s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-251ca51c-17f8-4089-b75f-463815cd9e15" released by "_delete_snapshot" :: held 3.226s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.325s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.251s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1014082213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47b6fce-5008-4f20-997f-20f970d4fcca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc21fb517f2f40a395a73f9535998073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:10Z,use_quota=True,user_id='e66eb9bd25b241aeb8f18d8b3d6b684e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Creating volume c47b6fce-5008-4f20-997f-20f970d4fcca {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:27 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf4916f-705f-4620-a833-25524ef08ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1304c163-d29a-4af9-8340-f004d62e5b77', 'volume_size': 1, 'source_volid': '4b41ac3b-a5b5-45e3-b696-26448d3fde81', 'source_volstatus': 'available'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab463ddf-68ac-4c97-b66f-177cc8897184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:27 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca 1073741824 Jun 27 04:37:27 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:27 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Volume volume-1304c163-d29a-4af9-8340-f004d62e5b77 (1304c163-d29a-4af9-8340-f004d62e5b77): created successfully Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab463ddf-68ac-4c97-b66f-177cc8897184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (054321c9-b097-41ed-a7dd-884d25ea28cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a587efd8-d0f9-4224-b9ad-f8fcc4d6ea43 tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:37:28 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca 1073741824" returned: 0 in 1.043s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:28 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca Jun 27 04:37:28 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (25923bd0-5129-4458-9082-e78c347c6250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602b6dbf-eb0c-4317-acd8-ed7a4ef1d823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602b6dbf-eb0c-4317-acd8-ed7a4ef1d823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1798769414',display_name='tempest-VolumesGetTest-Volume-1846655522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e457467-b3ee-4396-945a-4f70af09f97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:29Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aac1384-1cc5-4903-8caa-de937a90e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aac1384-1cc5-4903-8caa-de937a90e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b1c459-0c59-452d-b866-8843cf63470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b1c459-0c59-452d-b866-8843cf63470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e457467-b3ee-4396-945a-4f70af09f97c', 'volume_name': 'volume-3e457467-b3ee-4396-945a-4f70af09f97c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61e1673-9278-47fe-9452-9ec8b20e0908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61e1673-9278-47fe-9452-9ec8b20e0908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a70676-d2c8-41bc-91b1-c743ba6df123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Volume 3e457467-b3ee-4396-945a-4f70af09f97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e457467-b3ee-4396-945a-4f70af09f97c', 'volume_size': 1} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:29 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca" returned: 0 in 0.895s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1798769414',display_name='tempest-VolumesGetTest-Volume-1846655522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e457467-b3ee-4396-945a-4f70af09f97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:29Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Creating volume 3e457467-b3ee-4396-945a-4f70af09f97c {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:29 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c19d07-5f9d-43c0-b15a-8f8bc2f49576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47b6fce-5008-4f20-997f-20f970d4fcca', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72415843-9ba1-4b5c-abcc-c085f690b15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:29 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c 1073741824 Jun 27 04:37:29 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Volume volume-c47b6fce-5008-4f20-997f-20f970d4fcca (c47b6fce-5008-4f20-997f-20f970d4fcca): created successfully Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72415843-9ba1-4b5c-abcc-c085f690b15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Flow 'volume_create_manager' (6be2daca-1eb8-4da8-b570-8b5809d6eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-424f69b1-285b-422b-9d0a-c18e537b0a37 tempest-AttachVolumeNegativeTest-966199752 None] Created volume successfully. Jun 27 04:37:30 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c 1073741824" returned: 0 in 1.473s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:30 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c Jun 27 04:37:30 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:31 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c" returned: 0 in 0.777s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] <== create_volume: return (2298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a70676-d2c8-41bc-91b1-c743ba6df123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e457467-b3ee-4396-945a-4f70af09f97c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d383609e-14ef-4eab-b453-fbce407aa2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:31 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Volume volume-3e457467-b3ee-4396-945a-4f70af09f97c (3e457467-b3ee-4396-945a-4f70af09f97c): created successfully Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d383609e-14ef-4eab-b453-fbce407aa2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (25923bd0-5129-4458-9082-e78c347c6250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f726b541-9cbf-47e2-b48b-34ab49ab315f tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:37:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-3e457467-b3ee-4396-945a-4f70af09f97c-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Lock "cinder-3e457467-b3ee-4396-945a-4f70af09f97c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-3e457467-b3ee-4396-945a-4f70af09f97c" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-3e457467-b3ee-4396-945a-4f70af09f97c" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:32 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc6129-8454-4b6b-9713-c62aee12585e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:32 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c Jun 27 04:37:32 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:33 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c" returned: 0 in 1.101s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:33 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c Jun 27 04:37:33 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d3566a-4cdd-4d3b-aa58-924e9f847078]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:34 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca Jun 27 04:37:34 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:34 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-3e457467-b3ee-4396-945a-4f70af09f97c" returned: 0 in 0.777s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-3e457467-b3ee-4396-945a-4f70af09f97c" released by "delete_volume" :: held 1.952s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Created reservations ['2f201a51-b35b-4203-8849-84b735663fbc', 'e86980ac-fa08-4230-97d4-d34f7d5c057e', '76a96829-cd3f-434c-9135-2b50b278a25a', 'd9df1566-315e-409e-8278-bc9f1968fe84'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:34 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:34 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-1304c163-d29a-4af9-8340-f004d62e5b77-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Lock "cinder-1304c163-d29a-4af9-8340-f004d62e5b77-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-1304c163-d29a-4af9-8340-f004d62e5b77" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-1304c163-d29a-4af9-8340-f004d62e5b77" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cfec03-ee4b-4aa8-856e-a49630d1954f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:35 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca" returned: 0 in 1.271s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.311s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:35 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 Jun 27 04:37:35 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-c47b6fce-5008-4f20-997f-20f970d4fcca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff00032a-408e-42ce-a1cf-5b860de575ae', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:37:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-440d2f83-1358-4177-85d1-81d3c2ee637c req-9edc0e16-14a5-4363-9f5c-77620e78cbf4 tempest-AttachVolumeNegativeTest-966199752 None] attachment_update completed successfully. Jun 27 04:37:35 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.050s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:37:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aed73bfd-f03b-41d4-a139-ef02c9e93b1c tempest-VolumesGetTest-850357168 None] Lock "cinder-3e457467-b3ee-4396-945a-4f70af09f97c-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:36 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77" returned: 0 in 1.245s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:36 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77 Jun 27 04:37:36 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:37 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1304c163-d29a-4af9-8340-f004d62e5b77" returned: 0 in 0.899s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-1304c163-d29a-4af9-8340-f004d62e5b77" released by "delete_volume" :: held 2.233s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Created reservations ['4441acb1-2ae6-45ba-9ff7-cdffbf3ba9fd', '08e4fc81-dd6a-4807-a177-5b06bf1cd95c', '3eb60513-849f-4809-9768-7690d91d22d7', '0a17c9a5-3a7b-416e-815d-a45eac8eefcf'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:37 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:37 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:38 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.695s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7d86999-1d1d-49ed-969f-29330f05177a tempest-VolumesGetTest-850357168 None] Lock "cinder-1304c163-d29a-4af9-8340-f004d62e5b77-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-4b41ac3b-a5b5-45e3-b696-26448d3fde81-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Lock "cinder-4b41ac3b-a5b5-45e3-b696-26448d3fde81-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-4b41ac3b-a5b5-45e3-b696-26448d3fde81" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-4b41ac3b-a5b5-45e3-b696-26448d3fde81" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd22091-d668-4042-84ea-e033cc15f351]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:38 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:38 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:39 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 0.882s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:39 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81 Jun 27 04:37:39 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:40 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b41ac3b-a5b5-45e3-b696-26448d3fde81" returned: 0 in 0.679s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-4b41ac3b-a5b5-45e3-b696-26448d3fde81" released by "delete_volume" :: held 1.640s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Created reservations ['113a0686-66c9-4b3c-a22a-e7ecf472a97c', 'fe67cbbf-c061-4caf-a7ae-1192b2795694', 'c24eba37-b945-4e4a-8c29-69bd50ed0006', '3978947b-ae9a-4a6f-847c-cb735d215b33'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:40 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:40 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:41 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.763s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:41 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:37:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-84f106e3-2383-43c8-b268-4d7c0c3cc78d tempest-VolumesGetTest-850357168 None] Lock "cinder-4b41ac3b-a5b5-45e3-b696-26448d3fde81-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-a68a2695-afa3-45c4-b4cc-76ae197cc611 req-d0cb1864-aa19-4a31-85ce-6d11e13886ee tempest-AttachVolumeNegativeTest-966199752 None] Terminate volume connection completed successfully. Jun 27 04:37:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-a68a2695-afa3-45c4-b4cc-76ae197cc611 req-d0cb1864-aa19-4a31-85ce-6d11e13886ee tempest-AttachVolumeNegativeTest-966199752 None] Deleting attachment ff00032a-408e-42ce-a1cf-5b860de575ae. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:37:41 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (5dc443ee-5216-4a5b-a1f1-a0b7546daae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7809754e-0740-4da8-8d2f-fb79f60f7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7809754e-0740-4da8-8d2f-fb79f60f7e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949433235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea6b7d2-456f-4402-81a1-48b66c387597,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:42Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a6371f-32e4-44e7-9458-592dd12c2ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a6371f-32e4-44e7-9458-592dd12c2ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a6a785-9b86-4e0d-b056-26a2329f835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a6a785-9b86-4e0d-b056-26a2329f835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cea6b7d2-456f-4402-81a1-48b66c387597', 'volume_name': 'volume-cea6b7d2-456f-4402-81a1-48b66c387597', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfabb8a4-96aa-488a-b0ba-b4d52ae754e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfabb8a4-96aa-488a-b0ba-b4d52ae754e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e531f01-4639-4414-b87e-028f6d809d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:42 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Volume cea6b7d2-456f-4402-81a1-48b66c387597: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cea6b7d2-456f-4402-81a1-48b66c387597', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 04:37:42 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Trying to clone cea6b7d2-456f-4402-81a1-48b66c387597 from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Flow 'volume_create_manager' (9c21f0ee-72f4-4d46-a27d-d3b833bbe159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc141e98-1e18-4981-b17e-4934ff3b100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc141e98-1e18-4981-b17e-4934ff3b100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1144773631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55e8afa-c78d-4d60-bdb0-d9c4d5830294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee189d6784ad456f85a25149fb6bfb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:43Z,use_quota=True,user_id='c9c91dd2bc23400d8f093ec946ade44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2da3038-719f-4eb9-81c9-37868afa8f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2da3038-719f-4eb9-81c9-37868afa8f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a9c96d-e4c5-48ec-8699-6e0a01da9125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a9c96d-e4c5-48ec-8699-6e0a01da9125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55e8afa-c78d-4d60-bdb0-d9c4d5830294', 'volume_name': 'volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978f56ef-5ce1-4896-a961-7fa37d2cae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978f56ef-5ce1-4896-a961-7fa37d2cae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fd28c6-608d-46cb-b1b3-a96d6deb4cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:43 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Volume b55e8afa-c78d-4d60-bdb0-d9c4d5830294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294', 'volume_size': 1} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1144773631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55e8afa-c78d-4d60-bdb0-d9c4d5830294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee189d6784ad456f85a25149fb6bfb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:43Z,use_quota=True,user_id='c9c91dd2bc23400d8f093ec946ade44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Creating volume b55e8afa-c78d-4d60-bdb0-d9c4d5830294 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:43 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:43 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 1073741824 Jun 27 04:37:43 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:37:43 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Image download 20.69 MB at 20.69 MB/s Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49678a4-58b1-4ed0-a7ad-22711c7da39e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:43 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD Jun 27 04:37:43 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:44 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:44 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 is fetched for user 8ffff81869ac43bdb07df04d95b7cf36. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:37:44 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 1073741824" returned: 0 in 1.138s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:44 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d1cecb-31b6-459e-aab5-589f246b373c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:44 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 Jun 27 04:37:44 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:44 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD Jun 27 04:37:44 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:45 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fd28c6-608d-46cb-b1b3-a96d6deb4cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6e98ec-b444-4646-bb6c-b636d2d45448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:45 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Volume volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 (b55e8afa-c78d-4d60-bdb0-d9c4d5830294): created successfully Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6e98ec-b444-4646-bb6c-b636d2d45448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Flow 'volume_create_manager' (9c21f0ee-72f4-4d46-a27d-d3b833bbe159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:45 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b0c7b4d0-a3e4-4a70-9c26-bccead2b68c4 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Created volume successfully. Jun 27 04:37:45 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD" returned: 0 in 0.985s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1949433235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea6b7d2-456f-4402-81a1-48b66c387597,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:42Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Creating volume cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:45 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:45 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 1073741824 Jun 27 04:37:45 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:46 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 1073741824" returned: 0 in 1.222s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:46 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:37:46 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:47 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 0 in 0.741s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:37:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:47 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Attempting download of 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume cea6b7d2-456f-4402-81a1-48b66c387597. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:37:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7108d7-bea9-48db-8df1-8a2e022d567f]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:47 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw Jun 27 04:37:47 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:48 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:48 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw Jun 27 04:37:48 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:49 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw" returned: 1 in 0.784s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_w3npapkw' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b04fef-f6c1-41e4-bc74-5539e3ea459f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:49 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD Jun 27 04:37:49 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206c996-8a46-45cc-a74c-e224d18e21bb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:49 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 Jun 27 04:37:49 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:50 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:50 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] 65172e40-e60b-42ac-beb4-f7bdf5b877f2 was qcow2, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:37:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:50 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:37:50 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:50 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" returned: 0 in 1.087s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab218901-09c9-4c57-8eb6-321705b21849', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:37:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-6e0a5736-e3e0-4e7d-9dc4-59b53a3e3ddd req-5f5b1bdb-9a4a-4f4f-a6e2-f5b79ed2ec9f tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] attachment_update completed successfully. Jun 27 04:37:52 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 0 in 2.620s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:52 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_fxhnyzprdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:37:52 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Converted 112.00 MB image at 42.67 MB/s Jun 27 04:37:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:52 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 1G Jun 27 04:37:52 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "cinder-c47b6fce-5008-4f20-997f-20f970d4fcca-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-c47b6fce-5008-4f20-997f-20f970d4fcca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "cinder-quobyte-c47b6fce-5008-4f20-997f-20f970d4fcca" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-quobyte-c47b6fce-5008-4f20-997f-20f970d4fcca" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[def5faa5-48ab-4f28-825d-c4392776ae71]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:53 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 1G" returned: 0 in 0.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6b17a4-2459-480a-a20f-ee468f4234b6]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:53 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca Jun 27 04:37:53 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:53 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:37:53 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:54 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca" returned: 0 in 0.880s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:54 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca Jun 27 04:37:54 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:54 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 0 in 1.025s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:54 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:37:54 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:55 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c47b6fce-5008-4f20-997f-20f970d4fcca" returned: 0 in 0.709s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-quobyte-c47b6fce-5008-4f20-997f-20f970d4fcca" released by "delete_volume" :: held 1.644s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Created reservations ['e42183c3-cfb2-4ca7-a5dd-f7ddf2043336', '561e4caf-ae90-40c4-8357-4ce47c84bc67', 'e9831302-640c-4079-bef9-180e09c89b45', '30ad2e38-3387-4977-b04f-5ccecf62228b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:55 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:55 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:55 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 1 in 0.789s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Downloaded image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume cea6b7d2-456f-4402-81a1-48b66c387597 successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 for user 8ffff81869ac43bdb07df04d95b7cf36 is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Marking volume cea6b7d2-456f-4402-81a1-48b66c387597 as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Copying metadata from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 to cea6b7d2-456f-4402-81a1-48b66c387597. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Creating volume glance metadata for volume cea6b7d2-456f-4402-81a1-48b66c387597 backed by image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e531f01-4639-4414-b87e-028f6d809d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea6b7d2-456f-4402-81a1-48b66c387597', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebd621c-5689-44f8-9cd7-1f7db71a3cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:55 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Volume volume-cea6b7d2-456f-4402-81a1-48b66c387597 (cea6b7d2-456f-4402-81a1-48b66c387597): created successfully Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebd621c-5689-44f8-9cd7-1f7db71a3cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (5dc443ee-5216-4a5b-a1f1-a0b7546daae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:55 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e2c37792-6e99-43ac-94d7-e49808695cb5 tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "cinder-c16c78d1-21b7-486a-a0c1-11bb288b88fa-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-c16c78d1-21b7-486a-a0c1-11bb288b88fa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "cinder-quobyte-c16c78d1-21b7-486a-a0c1-11bb288b88fa" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-quobyte-c16c78d1-21b7-486a-a0c1-11bb288b88fa" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fcd688-baa6-4729-96e5-ba81e6aae52b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:56 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.970s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:56 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa Jun 27 04:37:56 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Deleted volume successfully. Jun 27 04:37:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-9ac1e224-5a81-4a7d-9186-82978a4ec34c req-535949be-61a5-4c0a-b44d-6d58f2146a69 tempest-AttachVolumeTestJSON-1319297077 None] Terminate volume connection completed successfully. Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-9ac1e224-5a81-4a7d-9186-82978a4ec34c req-535949be-61a5-4c0a-b44d-6d58f2146a69 tempest-AttachVolumeTestJSON-1319297077 None] Deleting attachment 40896e00-406d-4d03-b710-386bd1e725b3. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:37:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a35e278-4e03-46a5-8837-fa9f692b9ef8 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-c47b6fce-5008-4f20-997f-20f970d4fcca-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:57 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa" returned: 0 in 0.910s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:57 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa Jun 27 04:37:57 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (fa00325e-020f-4fef-bb00-af05b64da72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5319d43e-5e20-406f-a53d-4a6e11af6f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5319d43e-5e20-406f-a53d-4a6e11af6f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-641222842',display_name='tempest-VolumesGetTest-Volume-793886782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d193f46-4ea8-4b08-9120-983a4230198d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:58Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1bdf86-2209-439d-a89e-228794b7c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1bdf86-2209-439d-a89e-228794b7c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46fb1b1-aa32-420d-aaa0-baf8481532a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a46fb1b1-aa32-420d-aaa0-baf8481532a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d193f46-4ea8-4b08-9120-983a4230198d', 'volume_name': 'volume-1d193f46-4ea8-4b08-9120-983a4230198d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0ffb0e-684a-4657-aaac-44ec6bd52b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0ffb0e-684a-4657-aaac-44ec6bd52b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4396e42a-3b99-461a-b2bc-8070ed19b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:37:57 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Volume 1d193f46-4ea8-4b08-9120-983a4230198d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d193f46-4ea8-4b08-9120-983a4230198d', 'volume_size': 1} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:37:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-641222842',display_name='tempest-VolumesGetTest-Volume-793886782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d193f46-4ea8-4b08-9120-983a4230198d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59673c78a47e4585bd17a75641f5dd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:37:58Z,use_quota=True,user_id='8ffff81869ac43bdb07df04d95b7cf36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Creating volume 1d193f46-4ea8-4b08-9120-983a4230198d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:37:57 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:57 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d 1073741824 Jun 27 04:37:57 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:57 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c16c78d1-21b7-486a-a0c1-11bb288b88fa" returned: 0 in 0.812s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-quobyte-c16c78d1-21b7-486a-a0c1-11bb288b88fa" released by "delete_volume" :: held 1.796s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Created reservations ['25248032-905d-4f41-be16-b70c9cf65ece', '9c7fb26d-4aac-48b0-837f-a6ffc0673dae', '380e7569-a482-4ad1-aff7-d99dec51b18e', '2c032eb7-99ee-4d47-b4ed-511672a28159'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:58 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:37:58 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "cinder-5fafb14b-b152-4979-9dc3-b42df84d0f0f-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-5fafb14b-b152-4979-9dc3-b42df84d0f0f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-5867d034-c323-4207-add1-1cd4653f1082 req-d031868e-d093-4129-87bb-820116fcf65c tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Terminate volume connection completed successfully. Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-5867d034-c323-4207-add1-1cd4653f1082 req-d031868e-d093-4129-87bb-820116fcf65c tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Deleting attachment ab218901-09c9-4c57-8eb6-321705b21849. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "cinder-quobyte-5fafb14b-b152-4979-9dc3-b42df84d0f0f" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-quobyte-5fafb14b-b152-4979-9dc3-b42df84d0f0f" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cdf892-046a-469c-a908-64716f8ccef9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:58 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d 1073741824" returned: 0 in 1.261s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:37:59 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d Jun 27 04:37:59 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:59 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f Jun 27 04:37:59 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:37:59 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jun 27 04:37:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.369s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:37:59 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:37:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Deleted volume successfully. Jun 27 04:37:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9f7cd461-0292-40c6-ae8b-74ef9564f6de tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-c16c78d1-21b7-486a-a0c1-11bb288b88fa-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:00 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f" returned: 0 in 1.253s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:00 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f Jun 27 04:38:00 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:00 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d" returned: 0 in 1.225s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] <== create_volume: return (2546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.549s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4396e42a-3b99-461a-b2bc-8070ed19b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d193f46-4ea8-4b08-9120-983a4230198d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacd0268-a741-4f19-8b16-c73ac4ef419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:00 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Volume volume-1d193f46-4ea8-4b08-9120-983a4230198d (1d193f46-4ea8-4b08-9120-983a4230198d): created successfully Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacd0268-a741-4f19-8b16-c73ac4ef419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Flow 'volume_create_manager' (fa00325e-020f-4fef-bb00-af05b64da72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:38:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1c947cf6-3507-4fa7-ab60-7f4bd20ac15f tempest-VolumesGetTest-850357168 None] Created volume successfully. Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Acquiring lock "cinder-b55e8afa-c78d-4d60-bdb0-d9c4d5830294-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "cinder-b55e8afa-c78d-4d60-bdb0-d9c4d5830294-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Acquiring lock "cinder-quobyte-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "cinder-quobyte-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e1aacb-6d0d-4d4d-8833-818ddb461393]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-1d193f46-4ea8-4b08-9120-983a4230198d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Lock "cinder-1d193f46-4ea8-4b08-9120-983a4230198d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:01 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5fafb14b-b152-4979-9dc3-b42df84d0f0f" returned: 0 in 0.912s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-1d193f46-4ea8-4b08-9120-983a4230198d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-quobyte-5fafb14b-b152-4979-9dc3-b42df84d0f0f" released by "delete_volume" :: held 2.236s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-1d193f46-4ea8-4b08-9120-983a4230198d" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:01 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 Jun 27 04:38:01 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b47f6a-b855-4624-8407-d0b9373431e0]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Created reservations ['e1f49e17-0508-4de3-a5cb-b27d6396fbc9', '476d0c40-ce35-4861-8b61-7ce90c69f53d', '0e1e0db5-1e94-4626-aa91-7dc63c59d537', '5562d792-b38a-44e4-ba1f-47484aac1678'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:38:01 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d Jun 27 04:38:01 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:01 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:38:01 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:01 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:01 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294 Jun 27 04:38:01 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:02 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.828s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:38:02 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d" returned: 0 in 0.997s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Deleted volume successfully. Jun 27 04:38:02 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d Jun 27 04:38:02 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-85f1998a-9a8f-4646-93e0-92719d794ec9 tempest-AttachVolumeNegativeTest-966199752 None] Lock "cinder-5fafb14b-b152-4979-9dc3-b42df84d0f0f-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:02 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" returned: 0 in 0.928s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "cinder-quobyte-b55e8afa-c78d-4d60-bdb0-d9c4d5830294" released by "delete_volume" :: held 1.805s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Created reservations ['dc08055f-0d42-4e15-9db0-6347f986b574', '1a1ca737-1aff-4ef3-b821-4fa6d46027c8', '8679cf72-713f-4310-a1ca-4bc30cdea93a', 'c22755c6-4e27-48e2-be03-4b942c6629aa'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:02 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:38:02 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:02 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1d193f46-4ea8-4b08-9120-983a4230198d" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-1d193f46-4ea8-4b08-9120-983a4230198d" released by "delete_volume" :: held 1.883s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Created reservations ['c76db5b8-0146-45ff-b514-adaf9e2613c4', '30e4f406-4401-48c1-8e0e-ed370c673f6e', '0620e44e-56df-4075-a161-eea30dee1d67', 'b730a71b-738c-450f-b38c-937fb2557a5f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:03 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:38:03 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-cea6b7d2-456f-4402-81a1-48b66c387597-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Lock "cinder-cea6b7d2-456f-4402-81a1-48b66c387597-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Acquiring lock "cinder-quobyte-cea6b7d2-456f-4402-81a1-48b66c387597" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-cea6b7d2-456f-4402-81a1-48b66c387597" acquired by "delete_volume" :: waited 0.040s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f2e590-a9f2-450f-a576-144f90e8c9fd]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:04 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:38:04 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:04 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.339s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:38:04 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Deleted volume successfully. Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e421b213-bd05-4223-be2b-2e46af484a36 tempest-TestServerVolumeAttachScenarioOldVersion-1803895883 None] Lock "cinder-b55e8afa-c78d-4d60-bdb0-d9c4d5830294-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:04 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.135s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:38:04 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-203d656b-828d-4215-8004-b222386e3320 tempest-VolumesGetTest-850357168 None] Lock "cinder-1d193f46-4ea8-4b08-9120-983a4230198d-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:04 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 0 in 1.152s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:05 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:38:05 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:06 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 1 in 1.057s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:38:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:06 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597 Jun 27 04:38:06 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:06 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cea6b7d2-456f-4402-81a1-48b66c387597" returned: 0 in 0.936s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Lock "cinder-quobyte-cea6b7d2-456f-4402-81a1-48b66c387597" released by "delete_volume" :: held 3.280s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Created reservations ['cb04e9c5-ec7b-49b0-9918-5d105bce8e64', '94e69754-c7e3-4c93-a5a8-25dde34bf641', 'ae0e6557-bc1b-44f6-9bc5-4f6ac9834f8d', 'f79b88e3-001a-465d-86f7-dbb9bfaecc13'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:07 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:38:07 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:08 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:08 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:38:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Deleted volume successfully. Jun 27 04:38:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-166a0701-a8d2-491f-bc87-8773de68ce29 tempest-VolumesGetTest-850357168 None] Lock "cinder-cea6b7d2-456f-4402-81a1-48b66c387597-delete_volume" released by "delete_volume" :: held 4.632s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:17 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=95,cinder:SELECT=76,cinder:DELETE=9,cinder:INSERT=26 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=95,cinder:INSERT=29,cinder:SELECT=78,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Flow 'volume_create_manager' (36adedfc-e85a-445d-a51f-5942520733e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f257bf29-c7ed-4393-aa11-8f79f0b84b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f257bf29-c7ed-4393-aa11-8f79f0b84b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-451147112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b1241a-0505-47d9-8ff6-0b94d46ae26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cdba30ba6e49af9ecd1d72051e2ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:38:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:38:19Z,use_quota=True,user_id='9e42714d360245e9975bf26dab36896b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364fa2ba-a813-4cb8-ad28-ad81f8a32c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364fa2ba-a813-4cb8-ad28-ad81f8a32c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077c0e4c-46f9-4e1d-8f60-0b336ce5eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077c0e4c-46f9-4e1d-8f60-0b336ce5eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b1241a-0505-47d9-8ff6-0b94d46ae26b', 'volume_name': 'volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b', 'volume_size': 2}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e79bdc-39f9-4014-bec0-3ef2423b3fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e79bdc-39f9-4014-bec0-3ef2423b3fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ee477f-7626-4755-9b63-1b77a32669f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:18 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Volume a6b1241a-0505-47d9-8ff6-0b94d46ae26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b', 'volume_size': 2} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-451147112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b1241a-0505-47d9-8ff6-0b94d46ae26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cdba30ba6e49af9ecd1d72051e2ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:38:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:38:19Z,use_quota=True,user_id='9e42714d360245e9975bf26dab36896b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Creating volume a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:38:18 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:38:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b 2147483648 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:18 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b 2147483648 Jun 27 04:38:18 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:20 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b 2147483648" returned: 0 in 1.318s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:20 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b Jun 27 04:38:20 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:20 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:38:20 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:21 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" returned: 0 in 1.195s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] <== create_volume: return (2585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.590s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ee477f-7626-4755-9b63-1b77a32669f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b', 'volume_size': 2}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f915f2a9-8de6-41ef-b083-f4475c247ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:21 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Volume volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b (a6b1241a-0505-47d9-8ff6-0b94d46ae26b): created successfully Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f915f2a9-8de6-41ef-b083-f4475c247ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Flow 'volume_create_manager' (36adedfc-e85a-445d-a51f-5942520733e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:38:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7890b666-7aeb-4793-b4cf-a6c8d25cdd65 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Created volume successfully. Jun 27 04:38:21 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.160s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:38:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Creating offline snapshot a996aee7-ba16-4bf5-89cc-a4a514e32334 of volume a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:38:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b7812-eab4-4529-af92-9e9f03984697]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:22 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b Jun 27 04:38:22 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d0f746ea-e6ab-4656-825e-1667bc1f985f tempest-BackendsCapabilitiesAdminTestsJSON-798485249 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7402648925781, 'free_capacity_gb': 1775.7402648925781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 27 04:38:23 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" returned: 0 in 0.892s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 2G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:23 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 2G Jun 27 04:38:23 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e0c16ac-654d-4e94-8ccb-826a2b220e93 tempest-BackendsCapabilitiesAdminTestsJSON-798485249 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7402648925781, 'free_capacity_gb': 1775.7402648925781, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93772) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 27 04:38:24 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 2G" returned: 0 in 1.287s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:24 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 Jun 27 04:38:24 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:25 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334" returned: 0 in 0.855s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:25 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 is being set with open permissions: ugo+rw Jun 27 04:38:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:25 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 Jun 27 04:38:25 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:26 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334" returned: 0 in 0.761s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:26 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info Jun 27 04:38:26 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:27 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info" returned: 0 in 0.839s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:27 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info is being set with open permissions: ugo+rw Jun 27 04:38:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:27 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info Jun 27 04:38:27 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:27 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.info" returned: 0 in 0.759s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.547s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a4f0593e-37d9-431e-9f99-4654f4785aa6 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Create snapshot completed successfully Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "cinder-a996aee7-ba16-4bf5-89cc-a4a514e32334-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-a996aee7-ba16-4bf5-89cc-a4a514e32334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "cinder-quobyte-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-quobyte-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "cinder-quobyte-a996aee7-ba16-4bf5-89cc-a4a514e32334" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-quobyte-a996aee7-ba16-4bf5-89cc-a4a514e32334" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Deleting offline snapshot a996aee7-ba16-4bf5-89cc-a4a514e32334 of volume a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] snapshot_file for this snap is: volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec37c7-d863-41e0-a49f-e30266a827ff]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:29 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 Jun 27 04:38:29 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:29 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334" returned: 0 in 0.934s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:38:29 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea5a609-451f-415a-964c-05e3ce9fe8ed]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:30 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b Jun 27 04:38:30 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:30 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" returned: 0 in 0.996s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:31 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 Jun 27 04:38:31 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d36a1367-10e7-4cc2-9c9a-b7a9b39d1fcf tempest-GroupsV314Test-1185916203 None] Group tempest-GroupsV314Test-Group-1455347: creating Jun 27 04:38:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d36a1367-10e7-4cc2-9c9a-b7a9b39d1fcf tempest-GroupsV314Test-1185916203 None] Group tempest-GroupsV314Test-Group-1455347: created successfully Jun 27 04:38:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d36a1367-10e7-4cc2-9c9a-b7a9b39d1fcf tempest-GroupsV314Test-1185916203 None] Create group completed successfully. Jun 27 04:38:31 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334" returned: 0 in 0.941s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:31 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334 Jun 27 04:38:31 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:32 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b.a996aee7-ba16-4bf5-89cc-a4a514e32334" returned: 0 in 0.828s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-quobyte-a996aee7-ba16-4bf5-89cc-a4a514e32334" released by "_delete_snapshot" :: held 3.867s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-quobyte-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" released by "delete_snapshot" :: held 3.902s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:32 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Created reservations ['c08c9bc4-ac01-45b0-b205-a1aa1a69bc73', '366fd92a-b516-445b-883f-834be10880bd', '85e15e86-317a-48e1-96c8-33a8127f5aed', '06ec2fd7-fc8a-4ea9-a079-29cedda1e6be'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:38:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Delete snapshot completed successfully. Jun 27 04:38:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f55a13bd-58b9-4326-b5c5-96077cd6b912 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-a996aee7-ba16-4bf5-89cc-a4a514e32334-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Flow 'volume_create_manager' (ba1e09a7-66e3-4607-bcaf-164857852cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57f9ddb-c6ba-4c32-bf51-f9e7fe7e9e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57f9ddb-c6ba-4c32-bf51-f9e7fe7e9e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-837920064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745512da-b87f-46e4-bc88-f80c814ef1e0,host='devstack@QuobyteHD#QuobyteHD',id=e1f88f60-d183-4529-b384-8816df8b99e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047aeb3f7b74db388379ba83cd027e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:38:33Z,use_quota=True,user_id='d3c73650c3fc499d9b4fbf8b8af497a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70879555-e4ca-4aee-bccb-57dc2d2c1ce0),volume_type_id=70879555-e4ca-4aee-bccb-57dc2d2c1ce0)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacdd512-2d58-43f3-a10a-425e8af4451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eacdd512-2d58-43f3-a10a-425e8af4451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5abdd8-3987-4d7c-b6f5-7685aa440fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5abdd8-3987-4d7c-b6f5-7685aa440fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f88f60-d183-4529-b384-8816df8b99e7', 'volume_name': 'volume-e1f88f60-d183-4529-b384-8816df8b99e7', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c4b99f-776f-47a5-ad33-a7800dba58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c4b99f-776f-47a5-ad33-a7800dba58e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b642642-663e-48d3-978f-ad60248293df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:33 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Volume e1f88f60-d183-4529-b384-8816df8b99e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f88f60-d183-4529-b384-8816df8b99e7', 'volume_size': 1} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=745512da-b87f-46e4-bc88-f80c814ef1e0,created_at=2026-06-27T02:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-837920064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745512da-b87f-46e4-bc88-f80c814ef1e0,host='devstack@QuobyteHD#QuobyteHD',id=e1f88f60-d183-4529-b384-8816df8b99e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047aeb3f7b74db388379ba83cd027e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:38:33Z,use_quota=True,user_id='d3c73650c3fc499d9b4fbf8b8af497a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70879555-e4ca-4aee-bccb-57dc2d2c1ce0),volume_type_id=70879555-e4ca-4aee-bccb-57dc2d2c1ce0)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Creating volume e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:38:33 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:33 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 1073741824 Jun 27 04:38:33 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "cinder-a6b1241a-0505-47d9-8ff6-0b94d46ae26b-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-a6b1241a-0505-47d9-8ff6-0b94d46ae26b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "cinder-quobyte-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-quobyte-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d12159f-a802-4663-b973-c1544d031f28]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:33 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b Jun 27 04:38:33 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:34 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 1073741824" returned: 0 in 0.919s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:34 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:38:34 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:34 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" returned: 0 in 0.898s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:34 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b Jun 27 04:38:34 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:34 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 0.780s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b642642-663e-48d3-978f-ad60248293df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f88f60-d183-4529-b384-8816df8b99e7', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d82f4-b6e7-41b8-8a33-8427f949afe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:38:34 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Volume volume-e1f88f60-d183-4529-b384-8816df8b99e7 (e1f88f60-d183-4529-b384-8816df8b99e7): created successfully Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5d82f4-b6e7-41b8-8a33-8427f949afe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Flow 'volume_create_manager' (ba1e09a7-66e3-4607-bcaf-164857852cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:38:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bc00f7ec-14ca-4f84-ae34-4c645d79df29 tempest-GroupsV314Test-1185916203 None] Created volume successfully. Jun 27 04:38:34 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" returned: 0 in 0.714s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-quobyte-a6b1241a-0505-47d9-8ff6-0b94d46ae26b" released by "delete_volume" :: held 1.677s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Created reservations ['d5604c46-4091-42f5-bd15-fb39d408d601', 'a041128f-12e3-462e-9a5a-73ec95c65e9d', 'c5edea8c-7716-4fe1-ad6e-d2dfe077cee0', '4211e61b-3ba8-4a9e-861a-92086fdf0839'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:35 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:38:35 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:35 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:35 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:38:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Deleted volume successfully. Jun 27 04:38:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d065011c-af00-4d1b-b0f7-21814b78a1b3 tempest-VolumesSnapshotNegativeTestJSON-297830599 None] Lock "cinder-a6b1241a-0505-47d9-8ff6-0b94d46ae26b-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:37 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Cloning volume e1f88f60-d183-4529-b384-8816df8b99e7 to volume 4af9f699-e30f-48ae-8ab1-20dc5245654e Jun 27 04:38:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Creating offline snapshot 8fff18f6-c373-49f1-9e06-060ede6aeb46 of volume e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:38:37 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[400a02af-891d-449f-bf0f-4742cb9eebf3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:37 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:38:37 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:38 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 1.084s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:38 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 1G Jun 27 04:38:38 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:39 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 1G" returned: 0 in 1.106s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f88f60-d183-4529-b384-8816df8b99e7 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:39 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f88f60-d183-4529-b384-8816df8b99e7 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 Jun 27 04:38:39 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:40 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1f88f60-d183-4529-b384-8816df8b99e7 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46" returned: 0 in 1.379s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:40 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:38:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:40 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 Jun 27 04:38:40 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:41 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46" returned: 0 in 0.791s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:41 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info Jun 27 04:38:41 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:42 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info" returned: 0 in 1.140s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:42 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:38:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:42 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info Jun 27 04:38:42 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:43 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.info" returned: 0 in 0.849s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Acquiring lock "cinder-quobyte-4af9f699-e30f-48ae-8ab1-20dc5245654e" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-4af9f699-e30f-48ae-8ab1-20dc5245654e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] snapshot: 8fff18f6-c373-49f1-9e06-060ede6aeb46, volume: 4af9f699-e30f-48ae-8ab1-20dc5245654e, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83d9f2-a796-4d87-953c-d8557475ede8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:44 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 Jun 27 04:38:44 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:44 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46" returned: 0 in 1.091s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f88f60-d183-4529-b384-8816df8b99e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:38:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:38:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:38:44 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[896e3f63-7e22-4acb-92c6-cd91314904e4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:45 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:38:45 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:46 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 1.075s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:46 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:38:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:46 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e Jun 27 04:38:46 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:51 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:38:51 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=28,cinder:INSERT=8,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:38:52 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e" returned: 0 in 6.495s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:52 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d69f88-ce5d-476e-8fcc-76d1ed7460f9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:52 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:38:52 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:53 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 1.237s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:53 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:38:53 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Converted 1024.00 MB image at 157.64 MB/s Jun 27 04:38:53 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:38:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:53 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e Jun 27 04:38:53 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:54 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e" returned: 0 in 0.739s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-4af9f699-e30f-48ae-8ab1-20dc5245654e" released by "_copy_volume_from_snapshot" :: held 10.785s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Acquiring lock "cinder-quobyte-8fff18f6-c373-49f1-9e06-060ede6aeb46" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-8fff18f6-c373-49f1-9e06-060ede6aeb46" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Deleting offline snapshot 8fff18f6-c373-49f1-9e06-060ede6aeb46 of volume e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] snapshot_file for this snap is: volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d772624-533a-44cc-844c-0fc38ffb0498]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:54 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 Jun 27 04:38:54 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:55 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46" returned: 0 in 0.905s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1f88f60-d183-4529-b384-8816df8b99e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:38:55 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[710d1c7d-75b7-428e-8e5e-bac89ae8faf2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:38:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:55 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:38:55 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:56 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 0.937s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:56 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 Jun 27 04:38:56 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:57 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46" returned: 0 in 0.981s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:38:57 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46 Jun 27 04:38:57 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:38:58 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jun 27 04:38:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7.8fff18f6-c373-49f1-9e06-060ede6aeb46" returned: 0 in 0.866s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:38:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-8fff18f6-c373-49f1-9e06-060ede6aeb46" released by "_delete_snapshot" :: held 3.852s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:38:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.461s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:38:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d1e71da3-aae2-4663-a954-088020d844f9 tempest-GroupsV314Test-1185916203 None] Create group from source-group-745512da-b87f-46e4-bc88-f80c814ef1e0 completed successfully. Jun 27 04:39:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Acquiring lock "cinder-quobyte-4af9f699-e30f-48ae-8ab1-20dc5245654e" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:39:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-4af9f699-e30f-48ae-8ab1-20dc5245654e" acquired by "delete_volume" :: waited 0.038s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:39:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95da4b-df2e-4da9-81af-8d4fc9a6ad82]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:39:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:00 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e Jun 27 04:39:00 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:01 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e" returned: 0 in 0.917s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:01 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e Jun 27 04:39:01 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:02 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4af9f699-e30f-48ae-8ab1-20dc5245654e" returned: 0 in 0.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-4af9f699-e30f-48ae-8ab1-20dc5245654e" released by "delete_volume" :: held 1.818s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Created reservations ['1e58d0f2-c82e-46ef-a878-569385bc0261'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:39:02 devstack cinder-volume[93772]: WARNING cinder.quota [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-92527135 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-92527135, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:39:02 devstack cinder-volume[93772]: WARNING cinder.quota [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-92527135 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-92527135, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Created reservations ['f356f903-b61e-4492-b01a-e374101081a1', '6957d769-afc5-4074-8123-4470be41aa2a', '1f16c90e-fd13-4b16-b3fa-be04a7a5af8d', '9b0cf7db-29e7-4e2e-b6d2-c2786b47af2d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:02 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:39:02 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:03 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.853s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:03 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:39:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b4922dd8-da36-4c9b-8919-4dfaa582be01 tempest-GroupsV314Test-1185916203 None] Delete group completed successfully. Jun 27 04:39:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Acquiring lock "cinder-quobyte-e1f88f60-d183-4529-b384-8816df8b99e7" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:39:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-e1f88f60-d183-4529-b384-8816df8b99e7" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:39:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1c798c-7a9a-45d2-a859-06a08f056983]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:39:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:03 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:39:03 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:04 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 1.076s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:04 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7 Jun 27 04:39:04 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:05 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e1f88f60-d183-4529-b384-8816df8b99e7" returned: 0 in 0.918s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Lock "cinder-quobyte-e1f88f60-d183-4529-b384-8816df8b99e7" released by "delete_volume" :: held 2.099s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:39:05 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Created reservations ['9e144b61-44a4-4b77-8738-cadd4d3ffb5f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:39:05 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Created reservations ['af1bfa39-343a-4240-98f2-bc8fbb6d02ad', '384f8fa4-2c55-4e2a-830a-3925af00edf8', '883593c9-e838-43a8-8673-af7161f5a7d7', '0868732d-bb3b-49b3-adf7-81568230186a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:39:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:06 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:39:06 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:06 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.926s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:07 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:39:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b7bca1bd-7e67-4d0e-8977-d6b01b22c013 tempest-GroupsV314Test-1185916203 None] Delete group completed successfully. Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Flow 'volume_create_manager' (8d1c6a24-de1a-44c8-b108-62d61abddf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace4df3f-f233-4b41-8f5c-ea13432d505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace4df3f-f233-4b41-8f5c-ea13432d505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-9643404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300afeb7-cb43-4edf-956f-742f24ff8c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b1cabac4743a58ce89b3010ce03f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:12Z,use_quota=True,user_id='5b5df071de8445d580af1af604ea0d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2ca703-389f-4e45-90e0-7ab276f375a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2ca703-389f-4e45-90e0-7ab276f375a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa90060-f01e-4aba-85dd-d57fbcfea70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa90060-f01e-4aba-85dd-d57fbcfea70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300afeb7-cb43-4edf-956f-742f24ff8c72', 'volume_name': 'volume-300afeb7-cb43-4edf-956f-742f24ff8c72', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2350d86-0740-4319-a003-3012d39a4571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2350d86-0740-4319-a003-3012d39a4571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868355ba-9f5c-42d7-b70a-e161c383a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:11 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Volume 300afeb7-cb43-4edf-956f-742f24ff8c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300afeb7-cb43-4edf-956f-742f24ff8c72', 'volume_size': 1} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-9643404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300afeb7-cb43-4edf-956f-742f24ff8c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b1cabac4743a58ce89b3010ce03f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:12Z,use_quota=True,user_id='5b5df071de8445d580af1af604ea0d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Creating volume 300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:39:11 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:39:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:11 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 1073741824 Jun 27 04:39:11 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:13 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 1073741824" returned: 0 in 1.385s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:13 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:39:13 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:14 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 1.048s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] <== create_volume: return (2510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868355ba-9f5c-42d7-b70a-e161c383a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300afeb7-cb43-4edf-956f-742f24ff8c72', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0b2885-340c-4dd7-a339-938323f63d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:14 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Volume volume-300afeb7-cb43-4edf-956f-742f24ff8c72 (300afeb7-cb43-4edf-956f-742f24ff8c72): created successfully Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0b2885-340c-4dd7-a339-938323f63d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Flow 'volume_create_manager' (8d1c6a24-de1a-44c8-b108-62d61abddf58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:14 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a498f459-a4b6-4626-b598-acc1a1c2da0e tempest-TestStampPattern-497298467 None] Created volume successfully. Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Flow 'volume_create_manager' (bab66cb4-d1a1-4b3a-84ed-4e73cf054d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0418ecc-0fbe-4ab6-88cf-d381fe77b323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0418ecc-0fbe-4ab6-88cf-d381fe77b323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1491329778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c598a5-5306-49c2-a1a3-33391a53e305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519d934c17b74821ac2582b77ce4b852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:16Z,use_quota=True,user_id='de3d3ab8884b44f3a72c54ff932bc17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29e1d51d-de65-452c-a00f-8236f5e4f21b),volume_type_id=29e1d51d-de65-452c-a00f-8236f5e4f21b)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f359fc45-c243-4db6-b02d-5e832bf434a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f359fc45-c243-4db6-b02d-5e832bf434a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc211cc-8b75-4f59-af88-15e5ab4eaede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc211cc-8b75-4f59-af88-15e5ab4eaede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c598a5-5306-49c2-a1a3-33391a53e305', 'volume_name': 'volume-b2c598a5-5306-49c2-a1a3-33391a53e305', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce64842e-b204-4363-8570-27a290b5d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce64842e-b204-4363-8570-27a290b5d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b9ced1-8fe3-4705-839e-d752720cbb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:16 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Volume b2c598a5-5306-49c2-a1a3-33391a53e305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c598a5-5306-49c2-a1a3-33391a53e305', 'volume_size': 1} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1491329778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c598a5-5306-49c2-a1a3-33391a53e305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='519d934c17b74821ac2582b77ce4b852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:16Z,use_quota=True,user_id='de3d3ab8884b44f3a72c54ff932bc17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29e1d51d-de65-452c-a00f-8236f5e4f21b),volume_type_id=29e1d51d-de65-452c-a00f-8236f5e4f21b)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Creating volume b2c598a5-5306-49c2-a1a3-33391a53e305 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:39:16 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:39:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:16 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 1073741824 Jun 27 04:39:16 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:17 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 1073741824" returned: 0 in 1.046s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:17 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 Jun 27 04:39:17 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:18 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305" returned: 0 in 0.967s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b9ced1-8fe3-4705-839e-d752720cbb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c598a5-5306-49c2-a1a3-33391a53e305', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056d12ab-eb3e-41cb-bc76-317e5421cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:18 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Volume volume-b2c598a5-5306-49c2-a1a3-33391a53e305 (b2c598a5-5306-49c2-a1a3-33391a53e305): created successfully Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056d12ab-eb3e-41cb-bc76-317e5421cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Flow 'volume_create_manager' (bab66cb4-d1a1-4b3a-84ed-4e73cf054d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0cf567c5-5a9e-4d21-8aa0-94c457cd71b7 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Created volume successfully. Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:20 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:39:20 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:20 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:39:20 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:21 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.103s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:39:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dcd2649a-3ecb-493a-8503-825d5966dd90 tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Retype volume completed successfully. Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Acquiring lock "cinder-b2c598a5-5306-49c2-a1a3-33391a53e305-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "cinder-b2c598a5-5306-49c2-a1a3-33391a53e305-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Acquiring lock "cinder-quobyte-b2c598a5-5306-49c2-a1a3-33391a53e305" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "cinder-quobyte-b2c598a5-5306-49c2-a1a3-33391a53e305" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:39:21 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.319s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[268817c6-fcf0-4626-b78c-c4acf514a989]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:39:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:22 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 Jun 27 04:39:22 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:23 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305" returned: 0 in 1.050s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:23 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305 Jun 27 04:39:23 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:23 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b2c598a5-5306-49c2-a1a3-33391a53e305" returned: 0 in 0.739s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "cinder-quobyte-b2c598a5-5306-49c2-a1a3-33391a53e305" released by "delete_volume" :: held 1.846s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:39:23 devstack cinder-volume[93772]: WARNING cinder.quota [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:39:23 devstack cinder-volume[93772]: WARNING cinder.quota [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Created reservations ['113872f8-278f-41be-bc88-f90b00fbcf03', '818609e1-7abf-4426-808f-182f67c4abd5', '34b57c7d-a185-4f95-be1b-f6cc5eb329cc', '4c225b81-312d-44fe-adb6-5eec369b5a15'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:23 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:39:23 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:24 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.873s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:24 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:39:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Deleted volume successfully. Jun 27 04:39:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6838cac5-87c9-4cf5-883c-14454f59d49d tempest-VolumeRetypeWithoutMigrationTest-966510419 None] Lock "cinder-b2c598a5-5306-49c2-a1a3-33391a53e305-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:39:33 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=44,cinder:SELECT=37,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:39:34 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=42,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=2 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:39:49 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:39:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Flow 'volume_create_manager' (ef2e2e77-18c9-4030-9eae-5606e65a376f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51629951-4479-444f-8fd8-c38c7e68ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51629951-4479-444f-8fd8-c38c7e68ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1211956691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bc8fd5-c295-430c-aa1a-6f3d2891207b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d35b351f43b42e791e20a9587de5fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:50Z,use_quota=True,user_id='5c7b94a360a944eb84ed485d1277f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2e772c-0c17-4f12-9ee7-fe96ca66d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2e772c-0c17-4f12-9ee7-fe96ca66d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b35e9e-4e3e-4964-a6e4-db790875ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b35e9e-4e3e-4964-a6e4-db790875ec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9bc8fd5-c295-430c-aa1a-6f3d2891207b', 'volume_name': 'volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7338db1-ae59-418e-8e46-7f3802c70718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7338db1-ae59-418e-8e46-7f3802c70718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f36f1c6-90da-4962-b27c-6d60f0a2f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Volume b9bc8fd5-c295-430c-aa1a-6f3d2891207b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b', 'volume_size': 1} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1211956691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9bc8fd5-c295-430c-aa1a-6f3d2891207b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d35b351f43b42e791e20a9587de5fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:50Z,use_quota=True,user_id='5c7b94a360a944eb84ed485d1277f094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Creating volume b9bc8fd5-c295-430c-aa1a-6f3d2891207b {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:39:50 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:39:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:50 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b 1073741824 Jun 27 04:39:50 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:51 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b 1073741824" returned: 0 in 1.329s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:51 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b Jun 27 04:39:51 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:52 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f36f1c6-90da-4962-b27c-6d60f0a2f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fafb2ae-4450-4651-8f6b-3b34499f217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Volume volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b (b9bc8fd5-c295-430c-aa1a-6f3d2891207b): created successfully Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fafb2ae-4450-4651-8f6b-3b34499f217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Flow 'volume_create_manager' (ef2e2e77-18c9-4030-9eae-5606e65a376f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d193017d-9719-4124-8821-9ac1e3bd7778 tempest-TestMinimumBasicScenario-144622121 None] Created volume successfully. Jun 27 04:39:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:57 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d7adb2-3b38-49d6-b50b-b278cc05955d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:39:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:57 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b Jun 27 04:39:57 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:57 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Flow 'volume_create_manager' (eba8bbb4-98cc-40bf-bf99-ed1edb515128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70990997-37a8-41c0-bd8d-0faf69d84568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70990997-37a8-41c0-bd8d-0faf69d84568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-161831853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2555fc10-3a5f-49c6-8ecd-24b92d374f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525981eb02664f4ca7fc479f086f6841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:58Z,use_quota=True,user_id='5ac248781eb64a209ab8bf418a745239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b56ce7-fcc6-456d-8571-79275bef9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b56ce7-fcc6-456d-8571-79275bef9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff4f833-1368-44ae-886b-c86072ab6d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff4f833-1368-44ae-886b-c86072ab6d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2555fc10-3a5f-49c6-8ecd-24b92d374f27', 'volume_name': 'volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d646e8-df6d-4f43-89bf-3da564ac1661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d646e8-df6d-4f43-89bf-3da564ac1661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedf883b-bd79-408b-8de8-b4937dccdbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:39:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Volume 2555fc10-3a5f-49c6-8ecd-24b92d374f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27', 'volume_size': 1} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:58 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" returned: 0 in 1.028s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.119s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-161831853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2555fc10-3a5f-49c6-8ecd-24b92d374f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525981eb02664f4ca7fc479f086f6841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:39:58Z,use_quota=True,user_id='5ac248781eb64a209ab8bf418a745239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Creating volume 2555fc10-3a5f-49c6-8ecd-24b92d374f27 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:39:58 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:39:58 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 1073741824 Jun 27 04:39:58 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:39:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32a4f3f0-18c4-4c32-bc08-4f335177a50f', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:39:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-dbdac824-31c8-4a96-bfd5-6a9b3b0ac339 req-db438d6c-f53d-4681-9214-ba5ef77a8406 tempest-TestMinimumBasicScenario-144622121 None] attachment_update completed successfully. Jun 27 04:40:00 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 1073741824" returned: 0 in 1.680s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:00 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 Jun 27 04:40:00 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:00 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27" returned: 0 in 0.716s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] <== create_volume: return (2460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.462s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.468s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedf883b-bd79-408b-8de8-b4937dccdbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f0d8bd-ac6e-4ec8-b04f-e05fb27eda56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0275c22-a9c3-4c61-b63d-b625f8941312]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Volume volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 (2555fc10-3a5f-49c6-8ecd-24b92d374f27): created successfully Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f0d8bd-ac6e-4ec8-b04f-e05fb27eda56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Flow 'volume_create_manager' (eba8bbb4-98cc-40bf-bf99-ed1edb515128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:01 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c5b7835d-7263-495e-8e58-f53dce31fa89 tempest-AttachVolumeTestJSON-1319297077 None] Created volume successfully. Jun 27 04:40:01 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:40:01 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:01 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 0.934s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.979s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-300afeb7-cb43-4edf-956f-742f24ff8c72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edef1eff-ff34-4509-bc3a-632e33b62413', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:40:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-a9497c43-31e1-4cec-8cf3-fa9c840dd910 req-6ad53c02-759c-49a8-82fe-2cd68e963099 tempest-TestStampPattern-497298467 None] attachment_update completed successfully. Jun 27 04:40:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b91676-5c18-4e3e-a7f5-62b8b5a779c4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:05 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 Jun 27 04:40:05 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:06 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27" returned: 0 in 1.259s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.280s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be7edc0c-aaf6-477c-8033-7f93aef02e39', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:40:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-9191a9aa-0d9e-43e7-9bf6-69b157ebfa68 req-ffe7b153-4653-4420-8999-9860600abaf5 tempest-AttachVolumeTestJSON-1319297077 None] attachment_update completed successfully. Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Flow 'volume_create_manager' (7c090540-7ea6-42e0-8ac7-7cc889c25471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27c1246-3125-4556-aae0-7a08b9f3e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27c1246-3125-4556-aae0-7a08b9f3e84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1672055113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525981eb02664f4ca7fc479f086f6841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:13Z,use_quota=True,user_id='5ac248781eb64a209ab8bf418a745239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a3740b-e305-4f6b-a57c-c1866c839e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a3740b-e305-4f6b-a57c-c1866c839e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be17189-1694-4eb0-99c8-972191e0a2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be17189-1694-4eb0-99c8-972191e0a2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c', 'volume_name': 'volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1578e1f5-bcff-44c6-8475-dfddbb84a8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1578e1f5-bcff-44c6-8475-dfddbb84a8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac05db-6dca-4390-9d7f-bccfa5b0d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:12 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Volume 9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c', 'volume_size': 1} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1672055113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525981eb02664f4ca7fc479f086f6841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:13Z,use_quota=True,user_id='5ac248781eb64a209ab8bf418a745239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Creating volume 9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:40:12 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:40:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:12 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c 1073741824 Jun 27 04:40:12 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:13 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-c34759e7-b07b-4919-8b3a-826cfefe5e69 req-d781fb92-0428-42e8-a2cb-9e64bda42a9c tempest-TestStampPattern-497298467 None] Terminate volume connection completed successfully. Jun 27 04:40:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-c34759e7-b07b-4919-8b3a-826cfefe5e69 req-d781fb92-0428-42e8-a2cb-9e64bda42a9c tempest-TestStampPattern-497298467 None] Deleting attachment edef1eff-ff34-4509-bc3a-632e33b62413. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:40:14 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c 1073741824" returned: 0 in 1.606s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:14 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c Jun 27 04:40:14 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:15 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" returned: 0 in 0.787s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] <== create_volume: return (2451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac05db-6dca-4390-9d7f-bccfa5b0d775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd05638f-e998-4f07-9c28-aabe0e3ccc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Volume volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c (9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c): created successfully Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd05638f-e998-4f07-9c28-aabe0e3ccc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Flow 'volume_create_manager' (7c090540-7ea6-42e0-8ac7-7cc889c25471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ca0feae9-c0a1-49a3-af37-c0973146964b tempest-AttachVolumeTestJSON-1319297077 None] Created volume successfully. Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Creating offline snapshot e14b837a-ea0f-4cbc-9fa8-bad70dc31165 of volume 300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf483d0-a068-411c-88ec-7afb4c3dd771]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:15 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:40:15 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:16 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 1.078s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:16 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 1G Jun 27 04:40:16 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:17 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 1G" returned: 0 in 0.912s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300afeb7-cb43-4edf-956f-742f24ff8c72 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:17 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300afeb7-cb43-4edf-956f-742f24ff8c72 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 Jun 27 04:40:17 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:18 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-300afeb7-cb43-4edf-956f-742f24ff8c72 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165" returned: 0 in 0.903s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:18 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 is being set with open permissions: ugo+rw Jun 27 04:40:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:18 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 Jun 27 04:40:18 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:19 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165" returned: 0 in 0.674s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:19 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info Jun 27 04:40:19 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:19 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info" returned: 0 in 0.657s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:19 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info is being set with open permissions: ugo+rw Jun 27 04:40:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:19 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info Jun 27 04:40:19 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:20 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.info" returned: 0 in 0.662s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.991s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.560s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a601f6-8748-4452-bc37-34feceac7605]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:20 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-38e854ab-c46e-4ab1-ba75-ea1abd5020a1 tempest-TestStampPattern-497298467 None] Create snapshot completed successfully Jun 27 04:40:20 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c Jun 27 04:40:20 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:20 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:40:20 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:21 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:40:21 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" returned: 0 in 0.959s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccf9f8c8-b01b-4433-b45c-d2607118b09c', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:40:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-1f4520fd-51f7-4b44-82ae-e3bf76134c58 req-aed4ad43-fb4f-4190-8ffb-f18351100cae tempest-AttachVolumeTestJSON-1319297077 None] attachment_update completed successfully. Jun 27 04:40:28 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:40:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (5c435536-e41d-4969-a4a7-f0683f6dde44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e869a4d-4c76-48d0-b2b3-1d7eda4e55c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e869a4d-4c76-48d0-b2b3-1d7eda4e55c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455318505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cb1979-b031-4a6c-b644-935f0c758957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:29Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4499643-4aeb-4c8f-a7db-bac940284a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4499643-4aeb-4c8f-a7db-bac940284a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4458b3-9b56-4ea8-bdbf-07eb0bd6aeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4458b3-9b56-4ea8-bdbf-07eb0bd6aeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8cb1979-b031-4a6c-b644-935f0c758957', 'volume_name': 'volume-e8cb1979-b031-4a6c-b644-935f0c758957', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73d5259-26c2-44cf-8949-b059daa2e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73d5259-26c2-44cf-8949-b059daa2e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22a7caa-84b8-44a1-8c84-9e5c14fa7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Volume e8cb1979-b031-4a6c-b644-935f0c758957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8cb1979-b031-4a6c-b644-935f0c758957', 'volume_size': 1} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1455318505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8cb1979-b031-4a6c-b644-935f0c758957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:29Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Creating volume e8cb1979-b031-4a6c-b644-935f0c758957 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:40:29 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:40:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:29 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 1073741824 Jun 27 04:40:29 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:30 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 1073741824" returned: 0 in 1.258s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:30 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 Jun 27 04:40:30 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-dd2dc69d-3df4-4fde-806f-5b630637d9b3 req-bc43ce1d-6600-464e-8f6c-87ce392ea154 tempest-AttachVolumeTestJSON-1319297077 None] Terminate volume connection completed successfully. Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-dd2dc69d-3df4-4fde-806f-5b630637d9b3 req-bc43ce1d-6600-464e-8f6c-87ce392ea154 tempest-AttachVolumeTestJSON-1319297077 None] Deleting attachment be7edc0c-aaf6-477c-8033-7f93aef02e39. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:40:31 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957" returned: 0 in 1.093s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22a7caa-84b8-44a1-8c84-9e5c14fa7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8cb1979-b031-4a6c-b644-935f0c758957', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead79007-30ac-4eeb-9457-0a1466d4e23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:31 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Volume volume-e8cb1979-b031-4a6c-b644-935f0c758957 (e8cb1979-b031-4a6c-b644-935f0c758957): created successfully Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead79007-30ac-4eeb-9457-0a1466d4e23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (5c435536-e41d-4969-a4a7-f0683f6dde44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8ff2f0e9-3d30-4070-9ca8-274953a2cfb0 tempest-VolumesActionsTest-120093748 None] Created volume successfully. Jun 27 04:40:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-edc28e49-ab83-4fa2-a165-439446501c75 tempest-VolumesActionsTest-120093748 None] Acquiring lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957" by "attach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-edc28e49-ab83-4fa2-a165-439446501c75 tempest-VolumesActionsTest-120093748 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957" acquired by "attach_volume" :: waited 0.047s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-edc28e49-ab83-4fa2-a165-439446501c75 tempest-VolumesActionsTest-120093748 None] Attaching volume e8cb1979-b031-4a6c-b644-935f0c758957 to instance 2d2fdf33-8809-4529-a879-8cc29f19fbee at mountpoint /dev/vdb on host None. Jun 27 04:40:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-edc28e49-ab83-4fa2-a165-439446501c75 tempest-VolumesActionsTest-120093748 None] Attach volume completed successfully. Jun 27 04:40:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-edc28e49-ab83-4fa2-a165-439446501c75 tempest-VolumesActionsTest-120093748 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957" released by "attach_volume" :: held 0.251s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:33 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-460d6f2c-efd6-4648-a983-2b852b1f8f1f tempest-VolumesActionsTest-1568969564 None] Terminate volume connection completed successfully. Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-460d6f2c-efd6-4648-a983-2b852b1f8f1f tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-detach_volume" by "detach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-460d6f2c-efd6-4648-a983-2b852b1f8f1f tempest-VolumesActionsTest-1568969564 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-460d6f2c-efd6-4648-a983-2b852b1f8f1f tempest-VolumesActionsTest-1568969564 None] Detaching volume e8cb1979-b031-4a6c-b644-935f0c758957 from instance 2d2fdf33-8809-4529-a879-8cc29f19fbee. Jun 27 04:40:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-460d6f2c-efd6-4648-a983-2b852b1f8f1f tempest-VolumesActionsTest-1568969564 None] Detach volume completed successfully. Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-460d6f2c-efd6-4648-a983-2b852b1f8f1f tempest-VolumesActionsTest-1568969564 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Flow 'volume_create_manager' (19266d9b-8a42-4125-a467-b53b47c8734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48014379-8ba8-4543-927d-a4802793f155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48014379-8ba8-4543-927d-a4802793f155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-161078473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cad5c3-fd2f-4d07-8d02-a586f38d90c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4b1cabac4743a58ce89b3010ce03f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e14b837a-ea0f-4cbc-9fa8-bad70dc31165,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:34Z,use_quota=True,user_id='5b5df071de8445d580af1af604ea0d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795aed7-f7a6-455d-85df-b2f15375d6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b795aed7-f7a6-455d-85df-b2f15375d6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce82c267-7dd8-44a8-82e8-f9584bdf62b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce82c267-7dd8-44a8-82e8-f9584bdf62b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7cad5c3-fd2f-4d07-8d02-a586f38d90c0', 'volume_name': 'volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0', 'volume_size': 1, 'snapshot_id': 'e14b837a-ea0f-4cbc-9fa8-bad70dc31165'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1cbb4f-c2f8-4843-b3db-f968d5cfe493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1cbb4f-c2f8-4843-b3db-f968d5cfe493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2b5037-4d61-4302-8ba3-d63567163b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:34 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Volume f7cad5c3-fd2f-4d07-8d02-a586f38d90c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0', 'volume_size': 1, 'snapshot_id': 'e14b837a-ea0f-4cbc-9fa8-bad70dc31165'} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-quobyte-e14b837a-ea0f-4cbc-9fa8-bad70dc31165-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-e14b837a-ea0f-4cbc-9fa8-bad70dc31165-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Creating volume f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 from snapshot e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-quobyte-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c370ff84-263e-458f-8979-9bc8337b5e95 tempest-VolumesActionsTest-120093748 None] Acquiring lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-detach_volume" by "detach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] snapshot: e14b837a-ea0f-4cbc-9fa8-bad70dc31165, volume: f7cad5c3-fd2f-4d07-8d02-a586f38d90c0, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:40:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c370ff84-263e-458f-8979-9bc8337b5e95 tempest-VolumesActionsTest-120093748 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-detach_volume" acquired by "detach_volume" :: waited 0.084s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c370ff84-263e-458f-8979-9bc8337b5e95 tempest-VolumesActionsTest-120093748 None] Volume detach called, but volume not attached. Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7dee6-3661-45cb-be52-e34f36d96966]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c370ff84-263e-458f-8979-9bc8337b5e95 tempest-VolumesActionsTest-120093748 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-detach_volume" released by "detach_volume" :: held 0.200s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-237645c8-536f-4418-9eee-c964561554fb req-7a92b40f-2a92-4f39-af0c-63805d3308b3 tempest-AttachVolumeTestJSON-1319297077 None] Terminate volume connection completed successfully. Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-237645c8-536f-4418-9eee-c964561554fb req-7a92b40f-2a92-4f39-af0c-63805d3308b3 tempest-AttachVolumeTestJSON-1319297077 None] Deleting attachment ccf9f8c8-b01b-4433-b45c-d2607118b09c. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:40:35 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 Jun 27 04:40:35 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Acquiring lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Acquiring lock "cinder-quobyte-e8cb1979-b031-4a6c-b644-935f0c758957" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Lock "cinder-quobyte-e8cb1979-b031-4a6c-b644-935f0c758957" acquired by "delete_volume" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3714c7e3-1b5b-446e-905d-91c367458fb3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:36 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 Jun 27 04:40:36 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:36 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165" returned: 0 in 1.589s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300afeb7-cb43-4edf-956f-742f24ff8c72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b5f87f-3fde-4ea5-993f-eba104a300b9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:37 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:40:37 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:38 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957" returned: 0 in 2.002s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:38 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957 Jun 27 04:40:38 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:38 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 1.885s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:38 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:40:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:38 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 Jun 27 04:40:38 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:39 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e8cb1979-b031-4a6c-b644-935f0c758957" returned: 0 in 1.670s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Lock "cinder-quobyte-e8cb1979-b031-4a6c-b644-935f0c758957" released by "delete_volume" :: held 3.759s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Created reservations ['3bbf799b-4e91-40cf-81a4-3f6e0e0a21c4', '25877db8-0be0-41cd-bd2c-106e2f964c33', 'e45e2e35-d01e-4e35-a0de-356eed696114', '5570354f-e0ea-454f-96c9-07f11dcdeb5b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:40 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:40:40 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:42 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:42 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:40:42 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Deleted volume successfully. Jun 27 04:40:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8850a4d6-7a19-444c-8b7b-ceb836157856 tempest-VolumesActionsTest-120093748 None] Lock "cinder-e8cb1979-b031-4a6c-b644-935f0c758957-delete_volume" released by "delete_volume" :: held 6.443s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:48 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" returned: 0 in 9.899s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb213bc9-77da-4b9e-b757-5945e2c3cc4e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:48 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:40:48 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:49 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 1.310s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:49 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72, size 1024.00 MB, duration 9.90 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:40:49 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Converted 1024.00 MB image at 103.43 MB/s Jun 27 04:40:49 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 is being set with open permissions: ugo+rw Jun 27 04:40:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:49 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 Jun 27 04:40:49 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=34,cinder:INSERT=5,cinder:SELECT=45,cinder:DELETE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:40:50 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" returned: 0 in 0.826s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" released by "_copy_volume_from_snapshot" :: held 15.812s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-e14b837a-ea0f-4cbc-9fa8-bad70dc31165-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" released by "_create_volume_from_snapshot" :: held 15.892s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.923s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=58,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2b5037-4d61-4302-8ba3-d63567163b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0', 'volume_size': 1, 'snapshot_id': 'e14b837a-ea0f-4cbc-9fa8-bad70dc31165'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad60c3a1-add4-4daa-9ade-5a9a7d465704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Volume volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 (f7cad5c3-fd2f-4d07-8d02-a586f38d90c0): created successfully Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad60c3a1-add4-4daa-9ade-5a9a7d465704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Flow 'volume_create_manager' (19266d9b-8a42-4125-a467-b53b47c8734e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-6269b6b9-5508-4384-b489-d1584701e29b tempest-TestStampPattern-497298467 None] Created volume successfully. Jun 27 04:40:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "cinder-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "cinder-quobyte-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-quobyte-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1163bd8-21e0-48b1-a657-52fc22624cbd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:51 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c Jun 27 04:40:51 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:52 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" returned: 0 in 1.024s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:52 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c Jun 27 04:40:52 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (07f5e249-eaff-41f3-bc70-48f2b98e94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b5d02d-1565-46da-9406-fd73ff76b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b5d02d-1565-46da-9406-fd73ff76b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833366754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2b2137-9db3-4a7b-b263-1ca822ffb315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:52Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493962fb-239c-41ca-b9e1-72c0bd2b9401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493962fb-239c-41ca-b9e1-72c0bd2b9401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c56dbbe-5151-4008-91f5-9f9065d79eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c56dbbe-5151-4008-91f5-9f9065d79eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2b2137-9db3-4a7b-b263-1ca822ffb315', 'volume_name': 'volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cb9726-4499-4f69-b6e9-b3b1b0c8d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cb9726-4499-4f69-b6e9-b3b1b0c8d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bf9149-7cc9-4cce-ac07-12b83d2def88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Volume 4b2b2137-9db3-4a7b-b263-1ca822ffb315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315', 'volume_size': 1} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-833366754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2b2137-9db3-4a7b-b263-1ca822ffb315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:40:52Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Creating volume 4b2b2137-9db3-4a7b-b263-1ca822ffb315 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:40:52 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:40:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:52 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 1073741824 Jun 27 04:40:52 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:53 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" returned: 0 in 0.899s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-quobyte-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c" released by "delete_volume" :: held 1.984s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Created reservations ['82700eaf-fa1b-4699-a75d-84e8ce3c45fe', 'f20341af-ef46-4622-9aea-5e3e65aadb6f', '72bdb680-a610-4c4d-81f0-a7ba7f257963', '85218f54-1811-446b-910c-cbcb34df3cf9'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:53 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:40:53 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "cinder-2555fc10-3a5f-49c6-8ecd-24b92d374f27-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-2555fc10-3a5f-49c6-8ecd-24b92d374f27-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "cinder-quobyte-2555fc10-3a5f-49c6-8ecd-24b92d374f27" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-quobyte-2555fc10-3a5f-49c6-8ecd-24b92d374f27" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[220cbc27-c225-4b97-a315-ab58f8a7ac0e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:53 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 1073741824" returned: 0 in 1.049s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:53 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 Jun 27 04:40:53 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:53 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 Jun 27 04:40:53 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:54 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.792s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:40:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Deleted volume successfully. Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7de48e1-cdce-4cb7-a8e0-e42cd2379387 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-9fdd6e5c-d5e1-44eb-9ce2-6131ede0ce6c-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:54 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315" returned: 0 in 0.815s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bf9149-7cc9-4cce-ac07-12b83d2def88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b60eeb-41b6-4af8-b1f0-d07672dd20ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:40:54 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27" returned: 0 in 0.946s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Volume volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 (4b2b2137-9db3-4a7b-b263-1ca822ffb315): created successfully Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b60eeb-41b6-4af8-b1f0-d07672dd20ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:40:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (07f5e249-eaff-41f3-bc70-48f2b98e94ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:40:54 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27 Jun 27 04:40:54 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1fcdd629-d624-4d5b-abe6-f1d64618d72a tempest-VolumesActionsTest-120093748 None] Created volume successfully. Jun 27 04:40:55 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2555fc10-3a5f-49c6-8ecd-24b92d374f27" returned: 0 in 0.762s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-quobyte-2555fc10-3a5f-49c6-8ecd-24b92d374f27" released by "delete_volume" :: held 1.757s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Created reservations ['7d8fc21d-f524-4df5-a9a8-b34c32111d8d', '2034a682-f7d8-4f13-87c5-63638e15438c', 'c77b28b1-555b-4a2e-ac6b-603331b07093', '9164f12e-90ce-434e-8fec-6692f4c9b6ed'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:55 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:40:55 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-4b2b2137-9db3-4a7b-b263-1ca822ffb315-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Lock "cinder-4b2b2137-9db3-4a7b-b263-1ca822ffb315-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "cinder-c031475f-9126-4c38-a377-fa3cf7284f35-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-quobyte-4b2b2137-9db3-4a7b-b263-1ca822ffb315" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-c031475f-9126-4c38-a377-fa3cf7284f35-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-4b2b2137-9db3-4a7b-b263-1ca822ffb315" acquired by "delete_volume" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb2593-7e6e-4aed-8b9a-a42f1c875c14]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "cinder-quobyte-c031475f-9126-4c38-a377-fa3cf7284f35" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-quobyte-c031475f-9126-4c38-a377-fa3cf7284f35" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2f353d-6570-4038-af28-c281d734d36a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:56 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 Jun 27 04:40:56 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:56 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.914s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:40:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Deleted volume successfully. Jun 27 04:40:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0f99bfe2-6cc3-4b05-adee-4c2ac100e89b tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-2555fc10-3a5f-49c6-8ecd-24b92d374f27-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:56 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 Jun 27 04:40:56 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:57 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35" returned: 0 in 1.219s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:57 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:57 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35 Jun 27 04:40:57 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315" returned: 0 in 1.356s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:57 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315 Jun 27 04:40:57 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:58 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c031475f-9126-4c38-a377-fa3cf7284f35" returned: 0 in 1.034s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:58 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-quobyte-c031475f-9126-4c38-a377-fa3cf7284f35" released by "delete_volume" :: held 2.320s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4b2b2137-9db3-4a7b-b263-1ca822ffb315" returned: 0 in 1.022s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-4b2b2137-9db3-4a7b-b263-1ca822ffb315" released by "delete_volume" :: held 2.452s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Created reservations ['fd373524-7d38-4474-a3c0-58dd9153f776', 'a35967c1-b2f3-4218-819d-e014057b6e59', '733e458a-04ef-4db9-9666-7ae44bbcda20', 'b77f991e-8081-46b6-9448-6ede008b609d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Created reservations ['5ac784b9-1fc6-446e-bb66-97555e1b91b5', '81c86810-514c-4191-999a-787f57d1a462', 'a2178d8f-eb74-4b8d-8fa6-cfebc793bca7', 'db168990-910e-41cd-a912-cce1c34a6d0f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:40:58 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:40:58 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:40:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:40:58 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:40:58 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:40:59 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jun 27 04:40:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.271s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:40:59 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:40:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Deleted volume successfully. Jun 27 04:40:59 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.270s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Deleted volume successfully. Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fcf7c48f-38a5-4a0d-9229-eed0c54c93f9 tempest-AttachVolumeTestJSON-1319297077 None] Lock "cinder-c031475f-9126-4c38-a377-fa3cf7284f35-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (0c52e2db-52ef-4572-b137-d20481b27861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2911f22d-2267-4d39-aeab-489472e3765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2911f22d-2267-4d39-aeab-489472e3765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1262466616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a852da07-0742-4dcb-8778-e8ad1b8c3981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:00Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171954de-541b-4a3c-996d-b0253a5d2011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171954de-541b-4a3c-996d-b0253a5d2011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f4c7a2-84c2-400e-8bac-b128d5b24256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f4c7a2-84c2-400e-8bac-b128d5b24256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a852da07-0742-4dcb-8778-e8ad1b8c3981', 'volume_name': 'volume-a852da07-0742-4dcb-8778-e8ad1b8c3981', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0c001e-42de-4f92-95c6-0a9e3289dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0c001e-42de-4f92-95c6-0a9e3289dca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b214c8cc-1c3d-48fb-a743-ba4602fb12ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:00 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Volume a852da07-0742-4dcb-8778-e8ad1b8c3981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a852da07-0742-4dcb-8778-e8ad1b8c3981', 'volume_size': 1} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1262466616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a852da07-0742-4dcb-8778-e8ad1b8c3981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:00Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Creating volume a852da07-0742-4dcb-8778-e8ad1b8c3981 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:00 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4f6c2a9f-95b3-4705-ab0d-fe7d48c3275b tempest-VolumesActionsTest-1568969564 None] Lock "cinder-4b2b2137-9db3-4a7b-b263-1ca822ffb315-delete_volume" released by "delete_volume" :: held 4.336s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:00 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 1073741824 Jun 27 04:41:00 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:01 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 1073741824" returned: 0 in 1.338s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:01 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 Jun 27 04:41:01 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:02 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981" returned: 0 in 0.872s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b214c8cc-1c3d-48fb-a743-ba4602fb12ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a852da07-0742-4dcb-8778-e8ad1b8c3981', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d65203-9b8d-417c-87bc-c10f5ab9677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:02 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Volume volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 (a852da07-0742-4dcb-8778-e8ad1b8c3981): created successfully Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d65203-9b8d-417c-87bc-c10f5ab9677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (0c52e2db-52ef-4572-b137-d20481b27861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dbdd6d2d-82b7-4881-b7d0-df974632accb tempest-VolumesActionsTest-120093748 None] Created volume successfully. Jun 27 04:41:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-a852da07-0742-4dcb-8778-e8ad1b8c3981-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Lock "cinder-a852da07-0742-4dcb-8778-e8ad1b8c3981-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-quobyte-a852da07-0742-4dcb-8778-e8ad1b8c3981" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-a852da07-0742-4dcb-8778-e8ad1b8c3981" acquired by "delete_volume" :: waited 0.040s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[83775925-88e3-4767-9f76-008c7af350bb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:04 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 Jun 27 04:41:04 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:05 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981" returned: 0 in 1.197s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:05 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981 Jun 27 04:41:05 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:06 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a852da07-0742-4dcb-8778-e8ad1b8c3981" returned: 0 in 1.244s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-a852da07-0742-4dcb-8778-e8ad1b8c3981" released by "delete_volume" :: held 2.509s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Created reservations ['5b9e8f81-4fe1-4620-9c32-2e3de4dfbc33', '8333173f-4e17-4be9-b354-8f9568c42b1c', '2ac90632-d663-4baf-a040-e143a5c7ab24', '33ea4adb-5e5b-4d5a-8a30-dcefe2ceaafb'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:06 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:06 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:07 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.996s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:07 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Deleted volume successfully. Jun 27 04:41:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfd3d42-1b9f-4e5d-95b5-237538d1739c tempest-VolumesActionsTest-1568969564 None] Lock "cinder-a852da07-0742-4dcb-8778-e8ad1b8c3981-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (70201a9a-5abb-4685-830c-a33005574f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621ba78a-40e0-4590-86e2-38b3047f8f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621ba78a-40e0-4590-86e2-38b3047f8f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1339005390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a22f331-7fbb-4df0-8d9e-f747b28e94a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:08Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f49baf0-8b3a-442b-89c3-b928c626d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f49baf0-8b3a-442b-89c3-b928c626d980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e59023-bc8d-45e9-8c82-0c60bc15c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e59023-bc8d-45e9-8c82-0c60bc15c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a22f331-7fbb-4df0-8d9e-f747b28e94a8', 'volume_name': 'volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0418922-081e-4249-b589-6cda02b77be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0418922-081e-4249-b589-6cda02b77be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7136d19d-4ce8-4760-8411-f67da2725c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:08 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Volume 1a22f331-7fbb-4df0-8d9e-f747b28e94a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8', 'volume_size': 1} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1339005390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a22f331-7fbb-4df0-8d9e-f747b28e94a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:08Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Creating volume 1a22f331-7fbb-4df0-8d9e-f747b28e94a8 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:08 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:08 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 1073741824 Jun 27 04:41:08 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:09 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 1073741824" returned: 0 in 1.393s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:09 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 Jun 27 04:41:09 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:10 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8" returned: 0 in 0.898s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] <== create_volume: return (2349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7136d19d-4ce8-4760-8411-f67da2725c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cea0d8-213c-4ec7-aeb0-e0a55734fb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:10 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Volume volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 (1a22f331-7fbb-4df0-8d9e-f747b28e94a8): created successfully Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cea0d8-213c-4ec7-aeb0-e0a55734fb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (70201a9a-5abb-4685-830c-a33005574f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:10 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-aca2f38b-9cb7-4692-a135-a7faac9ddce4 tempest-VolumesActionsTest-120093748 None] Created volume successfully. Jun 27 04:41:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9f1debe1-e26d-4888-9d78-2a0b21d36433 tempest-GroupSnapshotsTest-1017936661 None] Group tempest-GroupSnapshotsTest-Group-558932364: creating Jun 27 04:41:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9f1debe1-e26d-4888-9d78-2a0b21d36433 tempest-GroupSnapshotsTest-1017936661 None] Group tempest-GroupSnapshotsTest-Group-558932364: created successfully Jun 27 04:41:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9f1debe1-e26d-4888-9d78-2a0b21d36433 tempest-GroupSnapshotsTest-1017936661 None] Create group completed successfully. Jun 27 04:41:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-25f359b8-96ed-4822-8daf-18fc86c7870d req-c9416dfa-f22d-4603-8b64-482fcd66b0d7 tempest-TestMinimumBasicScenario-144622121 None] Terminate volume connection completed successfully. Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-25f359b8-96ed-4822-8daf-18fc86c7870d req-c9416dfa-f22d-4603-8b64-482fcd66b0d7 tempest-TestMinimumBasicScenario-144622121 None] Deleting attachment 32a4f3f0-18c4-4c32-bc08-4f335177a50f. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-1a22f331-7fbb-4df0-8d9e-f747b28e94a8-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-1a22f331-7fbb-4df0-8d9e-f747b28e94a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-quobyte-1a22f331-7fbb-4df0-8d9e-f747b28e94a8" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-1a22f331-7fbb-4df0-8d9e-f747b28e94a8" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[336542d9-59c4-4e65-9e1e-2fdcb23ee4f4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:11 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 Jun 27 04:41:11 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:12 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8" returned: 0 in 0.815s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:12 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8 Jun 27 04:41:12 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:12 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (f8cb562e-ba82-4f07-84f8-8b12d7d91903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9c1cde-97d5-451e-a3d3-676797060947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9c1cde-97d5-451e-a3d3-676797060947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1780956092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=293ce356-aca5-49ef-b55e-a99e3d5e0c66,host='devstack@QuobyteHD#QuobyteHD',id=64c5251a-c74b-4833-b8ce-d8682e0e3e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:13Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e3fc15-bded-41f6-a678-61904fac9e05),volume_type_id=02e3fc15-bded-41f6-a678-61904fac9e05)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2957ec42-50b1-45b0-8007-8b7396d95c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2957ec42-50b1-45b0-8007-8b7396d95c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec36e207-d01e-4f5c-9c37-e7d99faeb808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec36e207-d01e-4f5c-9c37-e7d99faeb808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c5251a-c74b-4833-b8ce-d8682e0e3e4b', 'volume_name': 'volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1a6392-f50f-4d5a-9e0a-0d33b5fc9f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1a6392-f50f-4d5a-9e0a-0d33b5fc9f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef8bf93-61f4-40cc-a680-0fa5d42922e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:13 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Volume 64c5251a-c74b-4833-b8ce-d8682e0e3e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b', 'volume_size': 1} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=293ce356-aca5-49ef-b55e-a99e3d5e0c66,created_at=2026-06-27T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1780956092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=293ce356-aca5-49ef-b55e-a99e3d5e0c66,host='devstack@QuobyteHD#QuobyteHD',id=64c5251a-c74b-4833-b8ce-d8682e0e3e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:13Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02e3fc15-bded-41f6-a678-61904fac9e05),volume_type_id=02e3fc15-bded-41f6-a678-61904fac9e05)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Creating volume 64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:13 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:13 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b 1073741824 Jun 27 04:41:13 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:13 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-1a22f331-7fbb-4df0-8d9e-f747b28e94a8" returned: 0 in 0.784s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-1a22f331-7fbb-4df0-8d9e-f747b28e94a8" released by "delete_volume" :: held 1.643s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Acquiring lock "cinder-b9bc8fd5-c295-430c-aa1a-6f3d2891207b-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Lock "cinder-b9bc8fd5-c295-430c-aa1a-6f3d2891207b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Created reservations ['ee39212a-17dc-4fa0-a9b6-669603f7c07b', '37523961-9ed5-4c9e-82f3-c28aef8043ec', '51bbdf1f-e80d-4372-9bba-2ee803c27b14', 'a986a405-67d6-458f-99c4-622ba53f0134'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Acquiring lock "cinder-quobyte-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Lock "cinder-quobyte-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdfa88f-4df1-4e2d-9f13-a02506f834d9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:13 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:13 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:13 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b Jun 27 04:41:13 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:14 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b 1073741824" returned: 0 in 1.035s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:14 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:14 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:14 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.947s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:14 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Deleted volume successfully. Jun 27 04:41:14 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fd4269c0-b0f1-4db0-abca-208f4583a5d3 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-1a22f331-7fbb-4df0-8d9e-f747b28e94a8-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" returned: 0 in 1.089s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:14 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b Jun 27 04:41:14 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (ca1b8092-31b9-45b9-8c1a-c3c09120d172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290e502e-aab1-40d4-a97d-be54d5faa9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290e502e-aab1-40d4-a97d-be54d5faa9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-429540240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23297ae2-1bb2-450c-b775-a594790348c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:15Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064f0026-c53a-48d0-8eb6-41088c0aeac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064f0026-c53a-48d0-8eb6-41088c0aeac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc9d7ad-5c68-4ec6-9344-b5d660700c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc9d7ad-5c68-4ec6-9344-b5d660700c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23297ae2-1bb2-450c-b775-a594790348c7', 'volume_name': 'volume-23297ae2-1bb2-450c-b775-a594790348c7', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75366f7b-61ca-4c9f-aacc-84f88f9f129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75366f7b-61ca-4c9f-aacc-84f88f9f129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3905e8-4fd2-40c0-a755-1b9eb5545940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:14 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Volume 23297ae2-1bb2-450c-b775-a594790348c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23297ae2-1bb2-450c-b775-a594790348c7', 'volume_size': 1} Jun 27 04:41:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:15 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 0.832s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-429540240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23297ae2-1bb2-450c-b775-a594790348c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:15Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Creating volume 23297ae2-1bb2-450c-b775-a594790348c7 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:15 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:15 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 1073741824 Jun 27 04:41:15 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef8bf93-61f4-40cc-a680-0fa5d42922e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6075bc31-519a-45f7-8ab3-c833e559b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Volume volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b (64c5251a-c74b-4833-b8ce-d8682e0e3e4b): created successfully Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6075bc31-519a-45f7-8ab3-c833e559b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (f8cb562e-ba82-4f07-84f8-8b12d7d91903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-195db6c9-aa18-4d89-84b9-a21c87c20826 tempest-GroupSnapshotsTest-1017936661 None] Created volume successfully. Jun 27 04:41:15 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" returned: 0 in 0.674s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Lock "cinder-quobyte-b9bc8fd5-c295-430c-aa1a-6f3d2891207b" released by "delete_volume" :: held 1.813s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Created reservations ['33303ac5-ec11-402a-a764-b5ef7312cb9c', '58b1374f-127c-4655-8710-30d74e67ff0f', '09fa6924-4095-4c16-b2ec-e49d780b5228', '30dd1224-808f-44d7-8d7a-999b0f89e125'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:15 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:15 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] GroupSnapshot 902028d2-a3af-414b-8083-2c878f5b8bff: creating. Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Group snapshot 902028d2-a3af-414b-8083-2c878f5b8bff: creating. {{(pid=93772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 04:41:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:16 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 1073741824" returned: 0 in 1.135s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:16 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 Jun 27 04:41:16 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:16 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.821s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:16 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Deleted volume successfully. Jun 27 04:41:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-115033a2-b67b-48d6-a29b-c01defd4c391 tempest-TestMinimumBasicScenario-144622121 None] Lock "cinder-b9bc8fd5-c295-430c-aa1a-6f3d2891207b-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:17 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.071s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Creating offline snapshot 723d9ab3-e4d7-4c44-9047-edddf894ed97 of volume 64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3905e8-4fd2-40c0-a755-1b9eb5545940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23297ae2-1bb2-450c-b775-a594790348c7', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693481a0-56ae-4f7e-9df4-a68570029942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176b516-bb79-4d58-bc52-e0343e7dbd13]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:17 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Volume volume-23297ae2-1bb2-450c-b775-a594790348c7 (23297ae2-1bb2-450c-b775-a594790348c7): created successfully Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693481a0-56ae-4f7e-9df4-a68570029942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (ca1b8092-31b9-45b9-8c1a-c3c09120d172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:17 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8954d7a6-7f55-468b-b5ae-c35bbf9e2adc tempest-VolumesActionsTest-120093748 None] Created volume successfully. Jun 27 04:41:17 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:17 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-23297ae2-1bb2-450c-b775-a594790348c7-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-23297ae2-1bb2-450c-b775-a594790348c7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Acquiring lock "cinder-quobyte-23297ae2-1bb2-450c-b775-a594790348c7" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-23297ae2-1bb2-450c-b775-a594790348c7" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f99044-a23c-4fe8-ba84-84eb755fcb88]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:18 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 Jun 27 04:41:18 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:18 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 1.407s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:18 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 1G Jun 27 04:41:18 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:19 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7" returned: 0 in 1.049s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:19 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7 Jun 27 04:41:19 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:19 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 1G" returned: 0 in 1.110s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:19 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 Jun 27 04:41:19 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:19 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-23297ae2-1bb2-450c-b775-a594790348c7" returned: 0 in 0.759s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-quobyte-23297ae2-1bb2-450c-b775-a594790348c7" released by "delete_volume" :: held 1.865s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Created reservations ['432aabad-57c7-4832-bfa9-e22b0c9fc9dc', 'fc21f6a7-44e2-4daf-ba9a-e6ee490776d2', 'bd624cbd-2a15-411c-b6ea-2515321f0637', '848cad6f-8221-428e-bd71-f9ab696877ba'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:20 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:20 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:20 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97" returned: 0 in 0.779s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:20 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:20 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 Jun 27 04:41:20 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:20 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:20 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:21 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.869s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Deleted volume successfully. Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-10fae4c0-431c-434f-b435-ea5c7f34ea04 tempest-VolumesActionsTest-1568969564 None] Lock "cinder-23297ae2-1bb2-450c-b775-a594790348c7-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (6bbcd4ae-fc5c-49e5-9db9-c97cb8194a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c6f00a-8ffd-45fc-8f9b-6391a86efb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c6f00a-8ffd-45fc-8f9b-6391a86efb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-53279480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24e21f4-c427-44e4-9a33-b546769d1d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:21Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1629a9e-59db-4a44-90be-fda614aaf225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1629a9e-59db-4a44-90be-fda614aaf225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75c3e6b-15ec-4d47-ae54-cd22f3238bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a75c3e6b-15ec-4d47-ae54-cd22f3238bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24e21f4-c427-44e4-9a33-b546769d1d41', 'volume_name': 'volume-d24e21f4-c427-44e4-9a33-b546769d1d41', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32c0d11-29e4-4cdb-a7c5-438b38e7d87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32c0d11-29e4-4cdb-a7c5-438b38e7d87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0840c946-1357-4cd6-8193-0a87f42a7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:21 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Volume d24e21f4-c427-44e4-9a33-b546769d1d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24e21f4-c427-44e4-9a33-b546769d1d41', 'volume_size': 1} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:21 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97" returned: 0 in 0.838s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:21 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info Jun 27 04:41:21 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:21 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.885s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:21 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info" returned: 0 in 0.727s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:21 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:41:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:22 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info Jun 27 04:41:22 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:22 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.info" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.710s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-53279480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24e21f4-c427-44e4-9a33-b546769d1d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758a1d7dc9734c3eb5b7986be4b78d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:21Z,use_quota=True,user_id='037f7fa7749a4aa6a7dfab9b536feec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Creating volume d24e21f4-c427-44e4-9a33-b546769d1d41 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:22 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:22 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 1073741824 Jun 27 04:41:22 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:22 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c44a6c33-3d3c-48f1-9fcf-2686c42ec1db tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 902028d2-a3af-414b-8083-2c878f5b8bff: created successfully Jun 27 04:41:23 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 1073741824" returned: 0 in 1.188s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:24 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 Jun 27 04:41:24 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:24 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.064s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-723d9ab3-e4d7-4c44-9047-edddf894ed97-75407758-35bc-4af8-8039-3c6316289707" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0840c946-1357-4cd6-8193-0a87f42a7931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24e21f4-c427-44e4-9a33-b546769d1d41', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a86f2f5-4967-4512-a4b8-c9a15ec31e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-723d9ab3-e4d7-4c44-9047-edddf894ed97-75407758-35bc-4af8-8039-3c6316289707" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Creating volume 75407758-35bc-4af8-8039-3c6316289707 from snapshot 723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-75407758-35bc-4af8-8039-3c6316289707" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:24 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Volume volume-d24e21f4-c427-44e4-9a33-b546769d1d41 (d24e21f4-c427-44e4-9a33-b546769d1d41): created successfully Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a86f2f5-4967-4512-a4b8-c9a15ec31e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Flow 'volume_create_manager' (6bbcd4ae-fc5c-49e5-9db9-c97cb8194a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-75407758-35bc-4af8-8039-3c6316289707" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] snapshot: 723d9ab3-e4d7-4c44-9047-edddf894ed97, volume: 75407758-35bc-4af8-8039-3c6316289707, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:41:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cae55a4d-18a3-4274-8397-7ebca4223c4a tempest-VolumesActionsTest-120093748 None] Created volume successfully. Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bde4e01-be20-4466-a252-08df497b713a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:25 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 Jun 27 04:41:25 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:25 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97" returned: 0 in 0.833s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f994b0d-5342-45cb-88d8-1e396315eda3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:25 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:25 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Acquiring lock "cinder-d24e21f4-c427-44e4-9a33-b546769d1d41-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Lock "cinder-d24e21f4-c427-44e4-9a33-b546769d1d41-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Acquiring lock "cinder-quobyte-d24e21f4-c427-44e4-9a33-b546769d1d41" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Lock "cinder-quobyte-d24e21f4-c427-44e4-9a33-b546769d1d41" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e75b53-2131-4de7-9a60-7139dda5c0dd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:26 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 Jun 27 04:41:26 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:26 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 1.181s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:41:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:26 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 Jun 27 04:41:26 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:27 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41" returned: 0 in 1.024s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:27 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41 Jun 27 04:41:27 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:28 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d24e21f4-c427-44e4-9a33-b546769d1d41" returned: 0 in 0.982s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Lock "cinder-quobyte-d24e21f4-c427-44e4-9a33-b546769d1d41" released by "delete_volume" :: held 2.119s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Created reservations ['6313d88e-34be-4903-9b45-cd14eb717752', '2cdf84aa-235c-4ad3-9cb8-1287ce55e918', 'a6c1b49a-0544-4141-a592-63a878efd710', 'd16ac528-9b69-41a5-a688-0448f3e985de'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:28 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:28 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:30 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 2.032s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:30 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:30 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Deleted volume successfully. Jun 27 04:41:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7c35520-496f-4163-9eab-2540f221d22c tempest-VolumesActionsTest-120093748 None] Lock "cinder-d24e21f4-c427-44e4-9a33-b546769d1d41-delete_volume" released by "delete_volume" :: held 4.889s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:33 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707" returned: 0 in 6.528s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e369e10-6ca9-4546-8100-63497cf5a994]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:33 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:33 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:34 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 1.086s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:34 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:41:34 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Converted 1024.00 MB image at 156.80 MB/s Jun 27 04:41:34 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:41:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:34 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 Jun 27 04:41:34 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:35 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-75407758-35bc-4af8-8039-3c6316289707" released by "_copy_volume_from_snapshot" :: held 10.601s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-723d9ab3-e4d7-4c44-9047-edddf894ed97-75407758-35bc-4af8-8039-3c6316289707" released by "_create_volume_from_snapshot" :: held 10.661s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.709s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.908s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[66900a5c-79be-466c-9ce9-c01904ea19ea]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-05c7d121-9d77-4925-ae31-2ad257277734 tempest-GroupSnapshotsTest-1017936661 None] Create group from source-snapshot-902028d2-a3af-414b-8083-2c878f5b8bff completed successfully. Jun 27 04:41:35 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 Jun 27 04:41:35 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:36 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" returned: 0 in 1.216s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.243s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a2e2018-34e7-4fcf-9377-ef37d53a5d62', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-75407758-35bc-4af8-8039-3c6316289707" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-75407758-35bc-4af8-8039-3c6316289707" acquired by "delete_volume" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-5dff454c-4cb1-44be-8302-127c8e63aa76 req-18651692-377a-4f66-bb61-482617dc77b2 tempest-TestStampPattern-497298467 None] attachment_update completed successfully. Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc2d06-3b3f-401f-8361-160634273cbc]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:37 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 Jun 27 04:41:37 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:37 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707" returned: 0 in 1.018s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:37 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707 Jun 27 04:41:37 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:38 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-75407758-35bc-4af8-8039-3c6316289707" returned: 0 in 1.018s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-75407758-35bc-4af8-8039-3c6316289707" released by "delete_volume" :: held 2.095s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['756e30ab-be50-4a50-9d76-67dd72c9dae0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:39 devstack cinder-volume[93772]: WARNING cinder.quota [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-589839516 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-589839516, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:41:39 devstack cinder-volume[93772]: WARNING cinder.quota [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-589839516 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-589839516, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['63a6deef-0e5c-4fc3-9a98-bf76a6605ff9', 'e659acba-9acc-4e9a-8619-e759015a1804', '1da0e04a-3f7e-4a23-b5a7-00f19bf9567d', 'eca9ba97-46f8-4bd5-9877-fc0a726d2174'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:39 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:39 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:39 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 902028d2-a3af-414b-8083-2c878f5b8bff: deleting Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 902028d2-a3af-414b-8083-2c878f5b8bff: deleting {{(pid=93772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-723d9ab3-e4d7-4c44-9047-edddf894ed97" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-723d9ab3-e4d7-4c44-9047-edddf894ed97" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Deleting offline snapshot 723d9ab3-e4d7-4c44-9047-edddf894ed97 of volume 64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] snapshot_file for this snap is: volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a64d69-2ae9-470f-9220-da63aef5bd8e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:39 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 Jun 27 04:41:39 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:40 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.956s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:40 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:40 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bd9098a0-82a2-41e7-8be2-4c047d39a915 tempest-GroupSnapshotsTest-1017936661 None] Delete group completed successfully. Jun 27 04:41:40 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97" returned: 0 in 1.136s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:41:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[29084434-8fb3-4969-a243-e3b652e0168c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:41 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:41 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:41 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 0.979s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:41 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 Jun 27 04:41:41 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:43 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97" returned: 0 in 1.176s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:43 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97 Jun 27 04:41:43 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:43 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b.723d9ab3-e4d7-4c44-9047-edddf894ed97" returned: 0 in 0.857s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-723d9ab3-e4d7-4c44-9047-edddf894ed97" released by "_delete_snapshot" :: held 4.330s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" released by "delete_snapshot" :: held 4.387s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:44 devstack cinder-volume[93772]: WARNING cinder.quota [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-589839516 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-589839516, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:41:44 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['00aaba69-b929-4f96-9294-8fc9dd725faf', 'bfd31264-7dd5-4adc-8fb5-c43bbdff1cba', 'f49cfb81-17bd-4136-b4aa-f098b1b9a7f4', 'a8149507-3fa5-41e3-894b-b44fcce29c00'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-336d613e-20fa-4bda-9d55-6df586a2e021 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 902028d2-a3af-414b-8083-2c878f5b8bff: deleted successfully Jun 27 04:41:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-3a5a2092-9e5f-4675-8631-fa75dbf4f2f0 req-810354f2-f1a9-4cc0-ab91-59cce89c92a5 tempest-TestStampPattern-497298467 None] Terminate volume connection completed successfully. Jun 27 04:41:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3a5a2092-9e5f-4675-8631-fa75dbf4f2f0 req-810354f2-f1a9-4cc0-ab91-59cce89c92a5 tempest-TestStampPattern-497298467 None] Deleting attachment 3a2e2018-34e7-4fcf-9377-ef37d53a5d62. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:41:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:41:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:41:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c0322-4881-49db-adf5-8d0a5d0c3a99]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:45 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:45 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:46 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 1.227s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:46 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b Jun 27 04:41:46 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:47 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" returned: 0 in 0.963s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-64c5251a-c74b-4833-b8ce-d8682e0e3e4b" released by "delete_volume" :: held 2.314s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['95ff1768-2a9f-4162-8348-4c34afe0b639'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:48 devstack cinder-volume[93772]: WARNING cinder.db.sqlalchemy.api [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-589839516'] Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['3e037f45-bcb8-453e-96c9-fc91fa2c79bd', '68ae933e-c3ec-4b9e-adac-b2ee8403d634', '46a5dd85-d04b-4f31-8a92-22ed07d9f5bd', 'e2038fe9-1762-4f11-82b2-d5d2b91b1de0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:48 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:41:48 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Flow 'volume_create_manager' (f3027d41-7c8e-452a-928a-37c0e9f25366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8268ac-cac7-437d-8069-93afaa790a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8268ac-cac7-437d-8069-93afaa790a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1217893373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66bbc72-5edc-4243-9997-7a0187fe0033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d18040cb2546b692c55128aa049a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:48Z,use_quota=True,user_id='cf31f46601784e348c6103835ee8fa52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d8eac9-263f-47de-b5a1-6e80b9a779dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d8eac9-263f-47de-b5a1-6e80b9a779dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0ebb41-5606-40aa-a367-20bb982bbe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0ebb41-5606-40aa-a367-20bb982bbe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f66bbc72-5edc-4243-9997-7a0187fe0033', 'volume_name': 'volume-f66bbc72-5edc-4243-9997-7a0187fe0033', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e1f1c3-b204-43e8-8112-761787f2cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e1f1c3-b204-43e8-8112-761787f2cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7455a499-0fda-4c4e-9715-e42135d644fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:48 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Volume f66bbc72-5edc-4243-9997-7a0187fe0033: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f66bbc72-5edc-4243-9997-7a0187fe0033', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 04:41:48 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Trying to clone f66bbc72-5edc-4243-9997-7a0187fe0033 from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:41:49 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:41:49 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Image download 20.69 MB at 20.69 MB/s Jun 27 04:41:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ebe334-b553-4295-aba9-65b3a7869cfe]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:49 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.442s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:49 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:41:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-70c445e6-f841-4e93-8f81-af9c50ecaa20 tempest-GroupSnapshotsTest-1017936661 None] Delete group completed successfully. Jun 27 04:41:49 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD Jun 27 04:41:49 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8fbe6891-b336-4bfe-829d-d2522b43ca7c tempest-GroupSnapshotsTest-1017936661 None] Group tempest-GroupSnapshotsTest-Group-1328897960: creating Jun 27 04:41:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8fbe6891-b336-4bfe-829d-d2522b43ca7c tempest-GroupSnapshotsTest-1017936661 None] Group tempest-GroupSnapshotsTest-Group-1328897960: created successfully Jun 27 04:41:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8fbe6891-b336-4bfe-829d-d2522b43ca7c tempest-GroupSnapshotsTest-1017936661 None] Create group completed successfully. Jun 27 04:41:50 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD" returned: 0 in 1.374s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:50 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 is fetched for user cf31f46601784e348c6103835ee8fa52. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:41:51 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=106,cinder:UPDATE=130,cinder:INSERT=25,cinder:DELETE=5 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:41:51 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:DELETE=11,cinder:UPDATE=121,cinder:SELECT=106,cinder:INSERT=32 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:41:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b948b1b2-547a-4e80-a5af-8b1b373ad939]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:51 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD Jun 27 04:41:51 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (7733ba81-9606-4978-a532-aa2a14768172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d5fa6-88e0-4c4b-9d76-9ac617a4ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222d5fa6-88e0-4c4b-9d76-9ac617a4ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815875020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b685fee0-0f02-4ba8-b2bc-0bcb274e5a8b,host='devstack@QuobyteHD#QuobyteHD',id=de11aa3b-45dc-496d-af89-d5586c826ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:52Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3f8516b-0fe6-4a41-a132-a03509e1de83),volume_type_id=a3f8516b-0fe6-4a41-a132-a03509e1de83)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5157d0c4-3cfd-43a6-a2a1-721a62e36537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5157d0c4-3cfd-43a6-a2a1-721a62e36537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05348f6b-3ccb-4f94-887b-2e64fb6a9570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05348f6b-3ccb-4f94-887b-2e64fb6a9570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de11aa3b-45dc-496d-af89-d5586c826ee3', 'volume_name': 'volume-de11aa3b-45dc-496d-af89-d5586c826ee3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63afca8-b84d-4b5d-9932-b2b78ec4b8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f63afca8-b84d-4b5d-9932-b2b78ec4b8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4bc4db-1ef4-4719-aa58-68d2157a4d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Volume de11aa3b-45dc-496d-af89-d5586c826ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de11aa3b-45dc-496d-af89-d5586c826ee3', 'volume_size': 1} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b685fee0-0f02-4ba8-b2bc-0bcb274e5a8b,created_at=2026-06-27T02:41:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-815875020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b685fee0-0f02-4ba8-b2bc-0bcb274e5a8b,host='devstack@QuobyteHD#QuobyteHD',id=de11aa3b-45dc-496d-af89-d5586c826ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:52Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3f8516b-0fe6-4a41-a132-a03509e1de83),volume_type_id=a3f8516b-0fe6-4a41-a132-a03509e1de83)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Creating volume de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:52 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:52 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 1073741824 Jun 27 04:41:52 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:52 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD" returned: 0 in 1.378s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:53 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 1073741824" returned: 0 in 1.285s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:53 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 Jun 27 04:41:53 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:54 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3" returned: 0 in 1.063s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] <== create_volume: return (2406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.409s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1217893373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66bbc72-5edc-4243-9997-7a0187fe0033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d18040cb2546b692c55128aa049a5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:48Z,use_quota=True,user_id='cf31f46601784e348c6103835ee8fa52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Creating volume f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:54 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:54 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 1073741824 Jun 27 04:41:54 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4bc4db-1ef4-4719-aa58-68d2157a4d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de11aa3b-45dc-496d-af89-d5586c826ee3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d8337d-b5aa-479f-aa0d-be3b85b6ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Volume volume-de11aa3b-45dc-496d-af89-d5586c826ee3 (de11aa3b-45dc-496d-af89-d5586c826ee3): created successfully Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d8337d-b5aa-479f-aa0d-be3b85b6ed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (7733ba81-9606-4978-a532-aa2a14768172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5715caef-e57b-4c60-a2cf-936a2353d2c2 tempest-GroupSnapshotsTest-1017936661 None] Created volume successfully. Jun 27 04:41:55 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 1073741824" returned: 0 in 1.059s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:55 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:41:55 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:56 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 0 in 0.795s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (af35e42a-a8bb-4a7a-99f5-e1b537ab141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79f738a-3f84-4ab6-a62a-a4a49c768958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Attempting download of 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume f66bbc72-5edc-4243-9997-7a0187fe0033. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79f738a-3f84-4ab6-a62a-a4a49c768958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330782037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b685fee0-0f02-4ba8-b2bc-0bcb274e5a8b,host='devstack@QuobyteHD#QuobyteHD',id=812dde13-6866-4c35-8376-2068f63322e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:57Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3f8516b-0fe6-4a41-a132-a03509e1de83),volume_type_id=a3f8516b-0fe6-4a41-a132-a03509e1de83)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e7b51f-4077-4901-9193-55dd2cfbe91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e7b51f-4077-4901-9193-55dd2cfbe91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c407b2cc-b433-4639-a2ff-ce3bf3ebae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c407b2cc-b433-4639-a2ff-ce3bf3ebae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812dde13-6866-4c35-8376-2068f63322e3', 'volume_name': 'volume-812dde13-6866-4c35-8376-2068f63322e3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0a465e-9e15-4e9f-a289-0b80ea0618e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0a465e-9e15-4e9f-a289-0b80ea0618e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdcfcce-9b7e-4372-9347-d1baf979fd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Volume 812dde13-6866-4c35-8376-2068f63322e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812dde13-6866-4c35-8376-2068f63322e3', 'volume_size': 1} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b685fee0-0f02-4ba8-b2bc-0bcb274e5a8b,created_at=2026-06-27T02:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330782037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b685fee0-0f02-4ba8-b2bc-0bcb274e5a8b,host='devstack@QuobyteHD#QuobyteHD',id=812dde13-6866-4c35-8376-2068f63322e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:41:57Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3f8516b-0fe6-4a41-a132-a03509e1de83),volume_type_id=a3f8516b-0fe6-4a41-a132-a03509e1de83)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Creating volume 812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:41:56 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:56 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 1073741824 Jun 27 04:41:56 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9390f1d-1e72-408c-88d1-2e2d3789d38e]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:57 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s Jun 27 04:41:57 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:57 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s" returned: 0 in 0.955s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:57 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 1073741824" returned: 0 in 1.037s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:58 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 Jun 27 04:41:58 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:58 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s Jun 27 04:41:58 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:58 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3" returned: 0 in 0.692s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdcfcce-9b7e-4372-9347-d1baf979fd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812dde13-6866-4c35-8376-2068f63322e3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f517212d-2257-4edf-838a-46017352cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:41:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Volume volume-812dde13-6866-4c35-8376-2068f63322e3 (812dde13-6866-4c35-8376-2068f63322e3): created successfully Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f517212d-2257-4edf-838a-46017352cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (af35e42a-a8bb-4a7a-99f5-e1b537ab141b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:41:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-428ead41-c39a-4ef6-88eb-8e763b1f4bcd tempest-GroupSnapshotsTest-1017936661 None] Created volume successfully. Jun 27 04:41:58 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s" returned: 1 in 0.977s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_je0wbz1s' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[695dcd98-2ce7-4f20-a116-d0e8c00c2007]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:41:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:59 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD Jun 27 04:41:59 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:41:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7b4ba898-60f3-4057-a8eb-7441445248c8 tempest-GroupSnapshotsTest-1017936661 None] Update group completed successfully. Jun 27 04:41:59 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jun 27 04:41:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD" returned: 0 in 0.960s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:41:59 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] 65172e40-e60b-42ac-beb4-f7bdf5b877f2 was qcow2, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:41:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:41:59 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:41:59 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Lock "cinder-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-quobyte-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4ad4bb-0e03-4042-a001-c3a319dcb33d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:00 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 Jun 27 04:42:00 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bbd0d34d-291c-4817-945e-9bab9099fc77 tempest-GroupSnapshotsTest-1017936661 None] Update group completed successfully. Jun 27 04:42:01 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" returned: 0 in 1.212s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:01 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0 Jun 27 04:42:01 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:02 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" returned: 0 in 0.838s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0" released by "delete_volume" :: held 2.108s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dba81ca8-f52d-44be-b6b4-c83c21fefd51 tempest-GroupSnapshotsTest-1017936661 None] Update group completed successfully. Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Created reservations ['3127a082-ed3a-45dd-b6ea-6e399753a82b', 'f16faca5-3ab7-474d-9e17-eaf0c959194d', 'ab8b2676-6407-4fd8-935a-16abcfa3af47', '80f5dcf8-bd75-46d0-b1a4-5001b3a17bae'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:02 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:02 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:02 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 0 in 2.653s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_qmp_5_99devstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:42:02 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Converted 112.00 MB image at 42.19 MB/s Jun 27 04:42:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:02 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 1G Jun 27 04:42:02 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:03 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.714s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Deleted volume successfully. Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67e61f6b-2d97-4cdd-896c-361b03f98e4a tempest-TestStampPattern-497298467 None] Lock "cinder-f7cad5c3-fd2f-4d07-8d02-a586f38d90c0-delete_volume" released by "delete_volume" :: held 3.112s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:03 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 1G" returned: 0 in 0.884s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2384382-6003-4fcb-9899-f5c3c870e007]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d8835a8c-d23b-4277-86f9-934f637d791e tempest-GroupSnapshotsTest-1017936661 None] Update group completed successfully. Jun 27 04:42:03 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:42:03 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-e14b837a-ea0f-4cbc-9fa8-bad70dc31165-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Lock "cinder-e14b837a-ea0f-4cbc-9fa8-bad70dc31165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-quobyte-300afeb7-cb43-4edf-956f-742f24ff8c72" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-300afeb7-cb43-4edf-956f-742f24ff8c72" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-quobyte-e14b837a-ea0f-4cbc-9fa8-bad70dc31165" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-e14b837a-ea0f-4cbc-9fa8-bad70dc31165" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Deleting offline snapshot e14b837a-ea0f-4cbc-9fa8-bad70dc31165 of volume 300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] snapshot_file for this snap is: volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450640a-f096-4a60-a2a7-3e31b4c7e4d5]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:04 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 Jun 27 04:42:04 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:04 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 0 in 1.001s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:04 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:42:04 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:05 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165" returned: 0 in 1.108s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-300afeb7-cb43-4edf-956f-742f24ff8c72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aaa12e-3cd0-40fa-b07b-a3a24340a15c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] GroupSnapshot 53207027-f4de-466e-9e03-67561af5c9a7: creating. Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Group snapshot 53207027-f4de-466e-9e03-67561af5c9a7: creating. {{(pid=93772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Creating offline snapshot c2a2142f-4e92-4690-be49-62631cf66b55 of volume de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fb83ee-6dcf-47f2-bb08-4a45c5ed283a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:05 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:42:05 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:05 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 Jun 27 04:42:05 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:05 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 1 in 1.098s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Downloaded image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume f66bbc72-5edc-4243-9997-7a0187fe0033 successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 for user cf31f46601784e348c6103835ee8fa52 is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Marking volume f66bbc72-5edc-4243-9997-7a0187fe0033 as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Copying metadata from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 to f66bbc72-5edc-4243-9997-7a0187fe0033. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Creating volume glance metadata for volume f66bbc72-5edc-4243-9997-7a0187fe0033 backed by image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7455a499-0fda-4c4e-9715-e42135d644fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66bbc72-5edc-4243-9997-7a0187fe0033', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d9bca-0d06-42bb-afff-22772e54c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:05 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Volume volume-f66bbc72-5edc-4243-9997-7a0187fe0033 (f66bbc72-5edc-4243-9997-7a0187fe0033): created successfully Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d9bca-0d06-42bb-afff-22772e54c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Flow 'volume_create_manager' (f3027d41-7c8e-452a-928a-37c0e9f25366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f76cb435-44a5-4f0e-956a-bc1bf3e1a55f tempest-VolumesImageMetadata-977873201 None] Created volume successfully. Jun 27 04:42:06 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 1.086s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:06 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3" returned: 0 in 0.995s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:06 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 Jun 27 04:42:06 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:06 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 1G Jun 27 04:42:06 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:07 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165" returned: 0 in 1.126s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:07 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165 Jun 27 04:42:07 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:07 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 1G" returned: 0 in 1.228s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de11aa3b-45dc-496d-af89-d5586c826ee3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:07 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de11aa3b-45dc-496d-af89-d5586c826ee3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 Jun 27 04:42:07 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Acquiring lock "cinder-f66bbc72-5edc-4243-9997-7a0187fe0033-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Lock "cinder-f66bbc72-5edc-4243-9997-7a0187fe0033-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Acquiring lock "cinder-quobyte-f66bbc72-5edc-4243-9997-7a0187fe0033" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Lock "cinder-quobyte-f66bbc72-5edc-4243-9997-7a0187fe0033" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b58179-9b08-4913-a2b5-0af97fe4d1f5]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:07 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:42:07 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:08 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72.e14b837a-ea0f-4cbc-9fa8-bad70dc31165" returned: 0 in 0.811s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-e14b837a-ea0f-4cbc-9fa8-bad70dc31165" released by "_delete_snapshot" :: held 4.298s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-300afeb7-cb43-4edf-956f-742f24ff8c72" released by "delete_snapshot" :: held 4.334s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Created reservations ['593bb8a5-3443-4df9-b104-0c9ad2141c96', '2f1a023a-306e-4a7d-8988-dd513dac3860', '2c0bf10e-55d2-4acc-9547-f571d356fd33', '5ddd33fe-e6fc-44f2-8c6e-ae501d3b3aaf'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Delete snapshot completed successfully. Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-95685589-c4d2-4164-8160-5f891710ea65 tempest-TestStampPattern-497298467 None] Lock "cinder-e14b837a-ea0f-4cbc-9fa8-bad70dc31165-delete_snapshot" released by "delete_snapshot" :: held 4.551s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:08 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de11aa3b-45dc-496d-af89-d5586c826ee3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55" returned: 0 in 0.989s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:08 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:08 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 Jun 27 04:42:08 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Flow 'volume_create_manager' (d1f511bd-6e9f-4c62-bb37-fa2c6adee56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c6644e-4344-4cb7-80ca-cb820d624ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c6644e-4344-4cb7-80ca-cb820d624ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1835075878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b19901-2577-4ecf-8394-ce33c88978c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed033dcc495140b3b171eb13d62ab15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:09Z,use_quota=True,user_id='83b2945ed2a1415b83b3cf14b802a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dc71b7-f3fb-449f-9731-2a130ad787c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99dc71b7-f3fb-449f-9731-2a130ad787c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2a46b8-dec4-47fd-9ca6-cdb7fe584ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2a46b8-dec4-47fd-9ca6-cdb7fe584ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b19901-2577-4ecf-8394-ce33c88978c1', 'volume_name': 'volume-24b19901-2577-4ecf-8394-ce33c88978c1', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56aa7cd2-f813-4253-a8a1-c7c2f8f8bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56aa7cd2-f813-4253-a8a1-c7c2f8f8bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:08 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d715f45-6b56-4cda-8a45-4c950da49081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:08 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Volume 24b19901-2577-4ecf-8394-ce33c88978c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b19901-2577-4ecf-8394-ce33c88978c1', 'volume_size': 1} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 0 in 0.955s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:08 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:42:08 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Flow 'volume_create_manager' (3eb96b31-6080-4981-af1a-85a95c3d9069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7238ce69-e510-49db-bc0e-4978e2a81825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7238ce69-e510-49db-bc0e-4978e2a81825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-918705617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9801009f-f118-4006-a561-36628341107e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed033dcc495140b3b171eb13d62ab15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:09Z,use_quota=True,user_id='83b2945ed2a1415b83b3cf14b802a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96623eb2-c370-46a9-8b51-b7d133af744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96623eb2-c370-46a9-8b51-b7d133af744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8f8e57-58d8-4163-9bec-e3097ef2f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8f8e57-58d8-4163-9bec-e3097ef2f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9801009f-f118-4006-a561-36628341107e', 'volume_name': 'volume-9801009f-f118-4006-a561-36628341107e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213559a9-b049-4e78-84d8-d50f6820f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213559a9-b049-4e78-84d8-d50f6820f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75226fa-f197-45b4-8002-c67d4797b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Volume 9801009f-f118-4006-a561-36628341107e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9801009f-f118-4006-a561-36628341107e', 'volume_size': 1} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:09 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55" returned: 0 in 0.885s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:09 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info Jun 27 04:42:09 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:09 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 1 in 1.111s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:42:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:09 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033 Jun 27 04:42:09 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:10 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info" returned: 0 in 1.021s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:10 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:10 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info Jun 27 04:42:10 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:10 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f66bbc72-5edc-4243-9997-7a0187fe0033" returned: 0 in 0.936s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Lock "cinder-quobyte-f66bbc72-5edc-4243-9997-7a0187fe0033" released by "delete_volume" :: held 3.078s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Created reservations ['d86d9a42-b632-47a7-af03-dc3a5d36b59a', '01ab1f09-00fd-4905-b088-60383547f70f', 'b9d125fd-b358-4eab-9c27-6e750b78b02f', '67ddb7df-7678-4153-bb43-47ae273535db'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:11 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:11 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:11 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.info" returned: 0 in 0.853s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.091s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Creating offline snapshot efeb91bf-0f51-42ef-9650-076fb29c0034 of volume 812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c6d8e2-1aa9-4a3c-abc3-e5f1ed4649ad]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:11 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 Jun 27 04:42:11 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:12 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.389s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:12 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:12 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Deleted volume successfully. Jun 27 04:42:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bcc5a9c-fcf0-4d67-bf94-56717405e073 tempest-VolumesImageMetadata-977873201 None] Lock "cinder-f66bbc72-5edc-4243-9997-7a0187fe0033-delete_volume" released by "delete_volume" :: held 4.771s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:12 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3" returned: 0 in 1.583s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:12 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 1G Jun 27 04:42:12 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:14 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 1G" returned: 0 in 1.053s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-812dde13-6866-4c35-8376-2068f63322e3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:14 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-812dde13-6866-4c35-8376-2068f63322e3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 Jun 27 04:42:14 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:14 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-812dde13-6866-4c35-8376-2068f63322e3 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034" returned: 0 in 0.967s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:14 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:42:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:15 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 Jun 27 04:42:15 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:15 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034" returned: 0 in 0.843s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:15 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info Jun 27 04:42:15 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:16 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info" returned: 0 in 0.793s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:16 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:42:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:16 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info Jun 27 04:42:16 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:17 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.info" returned: 0 in 0.707s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.090s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.275s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-918705617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9801009f-f118-4006-a561-36628341107e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed033dcc495140b3b171eb13d62ab15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:09Z,use_quota=True,user_id='83b2945ed2a1415b83b3cf14b802a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Creating volume 9801009f-f118-4006-a561-36628341107e {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:17 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:17 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e 1073741824 Jun 27 04:42:17 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:17 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-751793e8-ebcf-4fdf-9fd1-2e0aab7d5497 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 53207027-f4de-466e-9e03-67561af5c9a7: created successfully Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Flow 'volume_create_manager' (8ac4244b-b2f5-418d-a935-e6bc2f4b6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea360d-4ece-4ec3-bbb7-c1b1c0b5b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea360d-4ece-4ec3-bbb7-c1b1c0b5b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1995517976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb56a592-6b31-43a9-8a98-6f23164a67b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e0b0488c404c768d674dce5ea4f70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:18Z,use_quota=True,user_id='dfaad1ad3c464d4ea0d708a293b4bafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79287d6a-7f6e-4cdb-b145-cb3bf6f8c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79287d6a-7f6e-4cdb-b145-cb3bf6f8c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d655687d-0e1e-4de4-a861-8565bc81331c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d655687d-0e1e-4de4-a861-8565bc81331c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb56a592-6b31-43a9-8a98-6f23164a67b3', 'volume_name': 'volume-cb56a592-6b31-43a9-8a98-6f23164a67b3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347fecdb-cba9-45fd-bd72-a9861bc633fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347fecdb-cba9-45fd-bd72-a9861bc633fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ca9e42-fb36-4f34-8e85-54c108ca2f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:17 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Volume cb56a592-6b31-43a9-8a98-6f23164a67b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb56a592-6b31-43a9-8a98-6f23164a67b3', 'volume_size': 1} Jun 27 04:42:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 53207027-f4de-466e-9e03-67561af5c9a7: deleting Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 53207027-f4de-466e-9e03-67561af5c9a7: deleting {{(pid=93772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-de11aa3b-45dc-496d-af89-d5586c826ee3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-de11aa3b-45dc-496d-af89-d5586c826ee3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-c2a2142f-4e92-4690-be49-62631cf66b55" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-c2a2142f-4e92-4690-be49-62631cf66b55" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Deleting offline snapshot c2a2142f-4e92-4690-be49-62631cf66b55 of volume de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] snapshot_file for this snap is: volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1eedd-e5a0-4670-bfa1-17cfd7226dee]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:18 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 Jun 27 04:42:18 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:18 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e 1073741824" returned: 0 in 1.098s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:18 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e Jun 27 04:42:18 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-300afeb7-cb43-4edf-956f-742f24ff8c72-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Lock "cinder-300afeb7-cb43-4edf-956f-742f24ff8c72-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Acquiring lock "cinder-quobyte-300afeb7-cb43-4edf-956f-742f24ff8c72" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-300afeb7-cb43-4edf-956f-742f24ff8c72" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[727eed1c-324d-4068-863e-708df68cbf8c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:18 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:42:18 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:19 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55" returned: 0 in 0.982s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de11aa3b-45dc-496d-af89-d5586c826ee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bf9142-7c4d-42f5-8d04-0fa4dee49906]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:19 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 Jun 27 04:42:19 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:19 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e" returned: 0 in 0.896s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.746s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1835075878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b19901-2577-4ecf-8394-ce33c88978c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed033dcc495140b3b171eb13d62ab15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:09Z,use_quota=True,user_id='83b2945ed2a1415b83b3cf14b802a34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Creating volume 24b19901-2577-4ecf-8394-ce33c88978c1 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:19 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75226fa-f197-45b4-8002-c67d4797b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9801009f-f118-4006-a561-36628341107e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:19 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 1073741824 Jun 27 04:42:19 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123d816b-8645-42c3-a6b3-09785052f3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:19 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Volume volume-9801009f-f118-4006-a561-36628341107e (9801009f-f118-4006-a561-36628341107e): created successfully Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123d816b-8645-42c3-a6b3-09785052f3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Flow 'volume_create_manager' (3eb96b31-6080-4981-af1a-85a95c3d9069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:19 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-48d09dc1-d95d-45a0-a723-bb7f019e9728 tempest-TestServerVolumeAttachmentScenario-987619019 None] Created volume successfully. Jun 27 04:42:19 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:19 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72 Jun 27 04:42:19 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:20 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3" returned: 0 in 1.000s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:20 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 Jun 27 04:42:20 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:20 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 1073741824" returned: 0 in 1.062s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:20 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 Jun 27 04:42:20 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:20 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:20 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:20 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-300afeb7-cb43-4edf-956f-742f24ff8c72" returned: 0 in 1.016s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Lock "cinder-quobyte-300afeb7-cb43-4edf-956f-742f24ff8c72" released by "delete_volume" :: held 2.078s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Created reservations ['506d4c49-108c-4744-bded-78468ed67708', 'fe089675-fcb6-4070-8048-c41dbdc06932', '5786c34d-c6a7-4894-8080-57e5359f395c', '3d0f3ebe-fcb1-4c35-a347-c8ac9b8ea967'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:21 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:21 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:21 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55" returned: 0 in 1.546s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:21 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55 Jun 27 04:42:21 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:21 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:21 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.285s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1" returned: 0 in 1.336s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] <== create_volume: return (2477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.050s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1995517976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb56a592-6b31-43a9-8a98-6f23164a67b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e0b0488c404c768d674dce5ea4f70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:18Z,use_quota=True,user_id='dfaad1ad3c464d4ea0d708a293b4bafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Creating volume cb56a592-6b31-43a9-8a98-6f23164a67b3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:21 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:42:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d715f45-6b56-4cda-8a45-4c950da49081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b19901-2577-4ecf-8394-ce33c88978c1', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:22 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 1073741824 Jun 27 04:42:22 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed36f7f-ccba-45a9-ae16-3fe4152cdf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:22 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Volume volume-24b19901-2577-4ecf-8394-ce33c88978c1 (24b19901-2577-4ecf-8394-ce33c88978c1): created successfully Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed36f7f-ccba-45a9-ae16-3fe4152cdf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Flow 'volume_create_manager' (d1f511bd-6e9f-4c62-bb37-fa2c6adee56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:22 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e1b52029-59c4-4ca1-aadb-27349163fa1c tempest-TestServerVolumeAttachmentScenario-987619019 None] Created volume successfully. Jun 27 04:42:22 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.194s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:22 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Deleted volume successfully. Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3206485a-3e33-4816-84dc-2a47b2e5c582 tempest-TestStampPattern-497298467 None] Lock "cinder-300afeb7-cb43-4edf-956f-742f24ff8c72-delete_volume" released by "delete_volume" :: held 3.931s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:22 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3.c2a2142f-4e92-4690-be49-62631cf66b55" returned: 0 in 1.160s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-c2a2142f-4e92-4690-be49-62631cf66b55" released by "_delete_snapshot" :: held 4.850s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-de11aa3b-45dc-496d-af89-d5586c826ee3" released by "delete_snapshot" :: held 4.889s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-812dde13-6866-4c35-8376-2068f63322e3" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-812dde13-6866-4c35-8376-2068f63322e3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-efeb91bf-0f51-42ef-9650-076fb29c0034" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-efeb91bf-0f51-42ef-9650-076fb29c0034" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Deleting offline snapshot efeb91bf-0f51-42ef-9650-076fb29c0034 of volume 812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] snapshot_file for this snap is: volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88d8d7-4140-4530-ba60-25d5a646ffd2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:23 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 Jun 27 04:42:23 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:23 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 1073741824" returned: 0 in 1.698s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:23 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 Jun 27 04:42:23 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:24 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034" returned: 0 in 0.941s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-812dde13-6866-4c35-8376-2068f63322e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4a3fc-ff14-4449-9a84-a2c9950f30d4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:24 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 Jun 27 04:42:24 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:24 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3" returned: 0 in 0.870s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.629s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ca9e42-fb36-4f34-8e85-54c108ca2f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb56a592-6b31-43a9-8a98-6f23164a67b3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4e1fa2-f0e7-4335-922b-aa83133bf7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:24 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Volume volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 (cb56a592-6b31-43a9-8a98-6f23164a67b3): created successfully Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4e1fa2-f0e7-4335-922b-aa83133bf7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Flow 'volume_create_manager' (8ac4244b-b2f5-418d-a935-e6bc2f4b6014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bd49be21-09f8-41f1-8645-128ffdce4713 tempest-VolumesTransfersV355Test-595427177 None] Created volume successfully. Jun 27 04:42:25 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3" returned: 0 in 0.890s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:25 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 Jun 27 04:42:25 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:26 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034" returned: 0 in 1.012s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:26 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034 Jun 27 04:42:26 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:26 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-97192297-e50c-4221-84ca-1ae933ba6e73 tempest-VolumesTransfersV355Test-1439040592 None] Transfer volume completed successfully. Jun 27 04:42:27 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3.efeb91bf-0f51-42ef-9650-076fb29c0034" returned: 0 in 0.982s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-efeb91bf-0f51-42ef-9650-076fb29c0034" released by "_delete_snapshot" :: held 3.975s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-812dde13-6866-4c35-8376-2068f63322e3" released by "delete_snapshot" :: held 4.005s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:27 devstack cinder-volume[93772]: WARNING cinder.quota [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1956938442 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1956938442, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:42:27 devstack cinder-volume[93772]: WARNING cinder.quota [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1956938442 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1956938442, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['0021bc5b-9b11-4d35-b565-878c5a5ee81b', '8d219dce-2815-457e-bb6f-d35f93e2bf73', 'b18d8f7b-401b-462c-8beb-59281b43a95c', '9eca85ba-a3bf-43d0-868a-3b90e0eee11d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['01fab561-076f-4cd4-89ec-f1dc72fa7905', 'aba1ab60-73c3-4d54-845d-749914f9de7a', '0872c115-5aef-4677-8ed8-284ad429b4c6', 'e012a576-6b53-48d8-a99e-77f78d7c2cbd'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fb7bf427-70fb-491c-8e53-710d0e5eac63 tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 53207027-f4de-466e-9e03-67561af5c9a7: deleted successfully Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Acquiring lock "cinder-cb56a592-6b31-43a9-8a98-6f23164a67b3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-cb56a592-6b31-43a9-8a98-6f23164a67b3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Acquiring lock "cinder-quobyte-cb56a592-6b31-43a9-8a98-6f23164a67b3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-quobyte-cb56a592-6b31-43a9-8a98-6f23164a67b3" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9be59fb-a2f6-4d8d-8f42-fe2a52d9cf22]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:28 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 Jun 27 04:42:28 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-812dde13-6866-4c35-8376-2068f63322e3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-812dde13-6866-4c35-8376-2068f63322e3" acquired by "delete_volume" :: waited 0.041s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020be34-d53d-4abf-a0d8-46a46893d0d5]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:29 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 Jun 27 04:42:29 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:29 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3" returned: 0 in 1.246s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:29 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3 Jun 27 04:42:29 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:30 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3" returned: 0 in 1.489s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:30 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3 Jun 27 04:42:30 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:30 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cb56a592-6b31-43a9-8a98-6f23164a67b3" returned: 0 in 1.565s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-quobyte-cb56a592-6b31-43a9-8a98-6f23164a67b3" released by "delete_volume" :: held 2.864s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:30 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Created reservations ['38de0a32-43f3-4644-b4ef-f9c617aafd97', 'f6ca0970-d7e6-433a-a4e6-5d530be71674', 'b17831da-5135-4379-a0fb-edba4852bf42', '429e3712-7cf0-45d4-a610-5e77f878c4c3'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:31 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:31 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:31 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-812dde13-6866-4c35-8376-2068f63322e3" returned: 0 in 1.091s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-812dde13-6866-4c35-8376-2068f63322e3" released by "delete_volume" :: held 2.718s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-de11aa3b-45dc-496d-af89-d5586c826ee3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-de11aa3b-45dc-496d-af89-d5586c826ee3" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd3fcdd-581a-44f2-aebc-ffea8a243fc1]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:31 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 Jun 27 04:42:31 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Flow 'volume_create_manager' (ad98f55b-ba2e-420f-9799-8fd116d505be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0758e584-4a74-4819-b64f-a2d29baa2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0758e584-4a74-4819-b64f-a2d29baa2d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-550136203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73146c79-a000-4857-a40d-4f5cb21fe9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e0b0488c404c768d674dce5ea4f70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:33Z,use_quota=True,user_id='dfaad1ad3c464d4ea0d708a293b4bafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:32 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd0fca-31f9-499c-a80f-a655d967561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd0fca-31f9-499c-a80f-a655d967561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eaa1b4-fe6d-44d9-bccd-7912adeae083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eaa1b4-fe6d-44d9-bccd-7912adeae083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73146c79-a000-4857-a40d-4f5cb21fe9a9', 'volume_name': 'volume-73146c79-a000-4857-a40d-4f5cb21fe9a9', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e75ef2e-77e5-43c9-8307-81ab6a54c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e75ef2e-77e5-43c9-8307-81ab6a54c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbd21e1-e89b-4817-8ae1-ec0a099fc33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Volume 73146c79-a000-4857-a40d-4f5cb21fe9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73146c79-a000-4857-a40d-4f5cb21fe9a9', 'volume_size': 1} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-550136203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73146c79-a000-4857-a40d-4f5cb21fe9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e0b0488c404c768d674dce5ea4f70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:33Z,use_quota=True,user_id='dfaad1ad3c464d4ea0d708a293b4bafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Creating volume 73146c79-a000-4857-a40d-4f5cb21fe9a9 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:32 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.869s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Deleted volume successfully. Jun 27 04:42:32 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 1073741824 Jun 27 04:42:32 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8eebe48c-94bb-49da-a281-f7813566ddca tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-cb56a592-6b31-43a9-8a98-6f23164a67b3-delete_volume" released by "delete_volume" :: held 5.119s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:33 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3" returned: 0 in 1.324s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:33 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3 Jun 27 04:42:33 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:34 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de11aa3b-45dc-496d-af89-d5586c826ee3" returned: 0 in 1.248s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-de11aa3b-45dc-496d-af89-d5586c826ee3" released by "delete_volume" :: held 2.730s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['94e8eb5a-5afd-44e4-874b-3df1870f0871'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:34 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 1073741824" returned: 0 in 1.643s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:34 devstack cinder-volume[93772]: WARNING cinder.quota [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1956938442 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1956938442, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['e137f9b9-d510-48c6-b8bd-65fdfa8de6f6', '87a5b9f5-fc00-408d-a4ae-2e670c6d63b6', 'aa9655d3-5a01-46b9-bcce-35f39fa16fe7', '092d0e86-822c-43cb-b8b8-b5306b29247f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:34 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 Jun 27 04:42:34 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['2f09e4ce-f867-4b3b-af60-171135ce98e1', '9bdd6361-f29b-4c3b-8fb9-8e166937f9b2', 'a7f4564d-d117-40e1-b7c9-5afbc1e020c5', '361bf297-0bbc-488c-b2ac-ea2a09530052'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:35 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:35 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:36 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9" returned: 0 in 1.522s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] <== create_volume: return (3245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.250s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbd21e1-e89b-4817-8ae1-ec0a099fc33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73146c79-a000-4857-a40d-4f5cb21fe9a9', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e11763-5eb0-4ee4-9b2c-98b86129a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:36 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Volume volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 (73146c79-a000-4857-a40d-4f5cb21fe9a9): created successfully Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e11763-5eb0-4ee4-9b2c-98b86129a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Flow 'volume_create_manager' (ad98f55b-ba2e-420f-9799-8fd116d505be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0fb8170d-773d-413d-a306-7ebf27d4105c tempest-VolumesTransfersV355Test-595427177 None] Created volume successfully. Jun 27 04:42:36 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.289s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b8ed21a9-a0cc-47c7-acaf-864e60f80611 tempest-GroupSnapshotsTest-1017936661 None] Delete group completed successfully. Jun 27 04:42:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-79f03b2c-63a4-4d54-b7a0-40d4062366d4 tempest-GroupSnapshotsTest-1017936661 None] Group tempest-GroupSnapshotsTest-Group-702107400: creating Jun 27 04:42:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-79f03b2c-63a4-4d54-b7a0-40d4062366d4 tempest-GroupSnapshotsTest-1017936661 None] Group tempest-GroupSnapshotsTest-Group-702107400: created successfully Jun 27 04:42:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-79f03b2c-63a4-4d54-b7a0-40d4062366d4 tempest-GroupSnapshotsTest-1017936661 None] Create group completed successfully. Jun 27 04:42:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Acquiring lock "cinder-73146c79-a000-4857-a40d-4f5cb21fe9a9-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-73146c79-a000-4857-a40d-4f5cb21fe9a9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Acquiring lock "cinder-quobyte-73146c79-a000-4857-a40d-4f5cb21fe9a9" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-quobyte-73146c79-a000-4857-a40d-4f5cb21fe9a9" acquired by "delete_volume" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:37 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd36ac54-86ba-4890-bdbd-4a4d0193905c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:38 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 Jun 27 04:42:38 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (59d8258e-3d36-4a14-808e-766076b8594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e1e67e-a57f-46d1-9c94-1896696002fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e1e67e-a57f-46d1-9c94-1896696002fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129976819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=baf950be-3a27-4ea5-9b8e-a4d029362938,host='devstack@QuobyteHD#QuobyteHD',id=06de18c9-6fff-473f-9267-7f73fca39238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:38Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6dd0e79-427a-4c1d-a762-87ab20e71328),volume_type_id=e6dd0e79-427a-4c1d-a762-87ab20e71328)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9107d93c-6e92-4524-a05d-d4fa4fc52660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9107d93c-6e92-4524-a05d-d4fa4fc52660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40447abc-e8ab-4de1-868f-c5babb66a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40447abc-e8ab-4de1-868f-c5babb66a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06de18c9-6fff-473f-9267-7f73fca39238', 'volume_name': 'volume-06de18c9-6fff-473f-9267-7f73fca39238', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef64b251-7778-4c34-b49c-12fceb8e7a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef64b251-7778-4c34-b49c-12fceb8e7a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89098ce3-e19a-448d-a5e5-97a054275fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:38 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Volume 06de18c9-6fff-473f-9267-7f73fca39238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06de18c9-6fff-473f-9267-7f73fca39238', 'volume_size': 1} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=baf950be-3a27-4ea5-9b8e-a4d029362938,created_at=2026-06-27T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129976819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=baf950be-3a27-4ea5-9b8e-a4d029362938,host='devstack@QuobyteHD#QuobyteHD',id=06de18c9-6fff-473f-9267-7f73fca39238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3fed728a64d6088459785fcb6e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:38Z,use_quota=True,user_id='d2467eda0524460788ef36899ef3ac87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6dd0e79-427a-4c1d-a762-87ab20e71328),volume_type_id=e6dd0e79-427a-4c1d-a762-87ab20e71328)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Creating volume 06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:38 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:42:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:38 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 1073741824 Jun 27 04:42:38 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:39 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9" returned: 0 in 1.289s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:39 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9 Jun 27 04:42:39 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:39 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 1073741824" returned: 0 in 1.071s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:39 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 Jun 27 04:42:39 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:40 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-73146c79-a000-4857-a40d-4f5cb21fe9a9" returned: 0 in 0.841s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-quobyte-73146c79-a000-4857-a40d-4f5cb21fe9a9" released by "delete_volume" :: held 2.209s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Created reservations ['15ccdcdb-3878-4810-8d4b-3d10e13dddfa', '0050a960-fe76-42bd-8aa5-1c7d8fb727f2', 'b9ebc23b-8615-491c-98a9-ceda53860e2f', 'b7b8bd51-2989-4d95-9b81-692d7694cbf9'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:40 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:40 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Flow 'volume_create_manager' (201a0958-88b7-4ca8-b6b8-419b3b41f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6effff44-640d-4af5-8c59-4ff31227364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:41 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238" returned: 0 in 1.107s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6effff44-640d-4af5-8c59-4ff31227364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1335923329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a818eb-e3c7-4a59-9330-aeb7cad3a624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f07e4f6eb5f4c92bdf9316fc0a33ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:41Z,use_quota=True,user_id='f7fa211a4d38416db8f02c14f17e6603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18259100-72b8-4660-a741-22d691db8322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18259100-72b8-4660-a741-22d691db8322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa36237-c79e-4660-9ce5-b161ac82be2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa36237-c79e-4660-9ce5-b161ac82be2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a818eb-e3c7-4a59-9330-aeb7cad3a624', 'volume_name': 'volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa294ac0-f080-4632-9e0b-42174441f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa294ac0-f080-4632-9e0b-42174441f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7b5222-4318-4fe2-8c32-7905d5872640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:41 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Volume 49a818eb-e3c7-4a59-9330-aeb7cad3a624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624', 'volume_size': 1} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1335923329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a818eb-e3c7-4a59-9330-aeb7cad3a624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f07e4f6eb5f4c92bdf9316fc0a33ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:41Z,use_quota=True,user_id='f7fa211a4d38416db8f02c14f17e6603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Creating volume 49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:41 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:41 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.839s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89098ce3-e19a-448d-a5e5-97a054275fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06de18c9-6fff-473f-9267-7f73fca39238', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26ce751-83dc-4868-97a4-61f0e926a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:41 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 1073741824 Jun 27 04:42:41 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Deleted volume successfully. Jun 27 04:42:41 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Volume volume-06de18c9-6fff-473f-9267-7f73fca39238 (06de18c9-6fff-473f-9267-7f73fca39238): created successfully Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26ce751-83dc-4868-97a4-61f0e926a535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Flow 'volume_create_manager' (59d8258e-3d36-4a14-808e-766076b8594f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c632bbbb-5c1b-4501-9cbe-07b09aeb5ae3 tempest-GroupSnapshotsTest-1017936661 None] Created volume successfully. Jun 27 04:42:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-257796d3-5f0e-420e-8e85-ad46be65c6e1 tempest-VolumesTransfersV355Test-459510310 None] Lock "cinder-73146c79-a000-4857-a40d-4f5cb21fe9a9-delete_volume" released by "delete_volume" :: held 3.556s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:42 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 1073741824" returned: 0 in 1.144s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:42 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:42:42 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:42 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] GroupSnapshot 44d74b15-221d-471b-a9ac-f12299ac1828: creating. Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Group snapshot 44d74b15-221d-471b-a9ac-f12299ac1828: creating. {{(pid=93772) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:43 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 0.913s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.139s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7b5222-4318-4fe2-8c32-7905d5872640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564c8c63-d8ac-42d2-85c8-20fa85af376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Creating offline snapshot 640531be-fe09-457a-a150-57c077bef053 of volume 06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:42:43 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Volume volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 (49a818eb-e3c7-4a59-9330-aeb7cad3a624): created successfully Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564c8c63-d8ac-42d2-85c8-20fa85af376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Flow 'volume_create_manager' (201a0958-88b7-4ca8-b6b8-419b3b41f60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2920e1-ad6e-42f1-bbe3-10a7fbfab730]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:43 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-62b8ec79-4935-44b1-93f4-8d87d424367a tempest-VolumeDependencyTests-91900247 None] Created volume successfully. Jun 27 04:42:43 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 Jun 27 04:42:43 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:44 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238" returned: 0 in 1.041s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:44 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 1G Jun 27 04:42:44 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:45 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 1G" returned: 0 in 0.963s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06de18c9-6fff-473f-9267-7f73fca39238 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:45 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06de18c9-6fff-473f-9267-7f73fca39238 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 Jun 27 04:42:45 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:46 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06de18c9-6fff-473f-9267-7f73fca39238 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053" returned: 0 in 0.727s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:46 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:42:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:46 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 Jun 27 04:42:46 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:46 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053" returned: 0 in 0.633s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:46 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info Jun 27 04:42:46 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:47 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info" returned: 0 in 0.740s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:47 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info is being set with open permissions: ugo+rw: NotImplementedError Jun 27 04:42:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:47 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info Jun 27 04:42:47 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:48 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.info" returned: 0 in 0.688s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.934s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.684s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Creating offline snapshot c0aa1c94-235d-4641-aaa1-de34786444bf of volume 49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2ff5fc-5201-41da-8567-226b3dd5641f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d57aa7e0-fb25-407d-bfbe-3dc3cc4c4dcf tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 44d74b15-221d-471b-a9ac-f12299ac1828: created successfully Jun 27 04:42:48 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:42:48 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 44d74b15-221d-471b-a9ac-f12299ac1828: deleting Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 44d74b15-221d-471b-a9ac-f12299ac1828: deleting {{(pid=93772) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-06de18c9-6fff-473f-9267-7f73fca39238" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-06de18c9-6fff-473f-9267-7f73fca39238" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-640531be-fe09-457a-a150-57c077bef053" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-640531be-fe09-457a-a150-57c077bef053" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Deleting offline snapshot 640531be-fe09-457a-a150-57c077bef053 of volume 06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] snapshot_file for this snap is: volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cfb086-ddb1-4256-8853-fa46afbcfb88]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:49 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 Jun 27 04:42:49 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:49 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 0.993s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:49 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf 1G Jun 27 04:42:49 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:49 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053" returned: 0 in 0.983s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06de18c9-6fff-473f-9267-7f73fca39238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:42:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5f2aa-1e5a-4b99-bbf6-4dfd9fe73bff]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:50 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 Jun 27 04:42:50 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:50 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf 1G" returned: 0 in 0.946s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:50 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf Jun 27 04:42:50 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:50 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238" returned: 0 in 0.904s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:50 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 Jun 27 04:42:50 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:50 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf" returned: 0 in 0.857s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:51 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf is being set with open permissions: ugo+rw Jun 27 04:42:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:51 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf Jun 27 04:42:51 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:51 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053" returned: 0 in 1.142s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:52 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053 Jun 27 04:42:52 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:52 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf" returned: 0 in 1.028s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:INSERT=33,cinder:SELECT=107,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=104,cinder:SELECT=109,cinder:INSERT=33,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:52 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info Jun 27 04:42:52 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:52 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238.640531be-fe09-457a-a150-57c077bef053" returned: 0 in 0.827s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-640531be-fe09-457a-a150-57c077bef053" released by "_delete_snapshot" :: held 4.016s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-06de18c9-6fff-473f-9267-7f73fca39238" released by "delete_snapshot" :: held 4.048s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:52 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info" returned: 0 in 0.864s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:52 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info is being set with open permissions: ugo+rw Jun 27 04:42:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:53 devstack cinder-volume[93772]: WARNING cinder.quota [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-640515189 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-640515189, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:42:53 devstack cinder-volume[93772]: WARNING cinder.quota [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-640515189 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-640515189, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:42:53 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info Jun 27 04:42:53 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:53 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['1141e290-27f9-4d72-8235-013a02e347db', 'a31fced3-2da8-48ce-ade7-f7e155504328', '432ff68c-3569-4fa9-bace-f9ee7ec1bc8c', '680d2cae-2ad8-459a-94fa-14d5c83a98ad'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-aedae81f-1606-485a-9dc4-f4fa2c4012de tempest-GroupSnapshotsTest-1017936661 None] group_snapshot 44d74b15-221d-471b-a9ac-f12299ac1828: deleted successfully Jun 27 04:42:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "cinder-quobyte-06de18c9-6fff-473f-9267-7f73fca39238" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-06de18c9-6fff-473f-9267-7f73fca39238" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:53 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd09d0-b19c-494c-a275-d75a18cec759]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:53 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.info" returned: 0 in 1.028s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.863s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e814383b-b09d-4a72-b9ee-53c424dc1923 tempest-VolumeDependencyTests-91900247 None] Create snapshot completed successfully Jun 27 04:42:54 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 Jun 27 04:42:54 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:54 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238" returned: 0 in 0.909s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:54 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238 Jun 27 04:42:54 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:56 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-06de18c9-6fff-473f-9267-7f73fca39238" returned: 0 in 1.189s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Lock "cinder-quobyte-06de18c9-6fff-473f-9267-7f73fca39238" released by "delete_volume" :: held 2.200s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Flow 'volume_create_manager' (2f379fb2-4dd9-40db-adad-657e034d11aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab49da8-d56e-4b2f-869e-92ddd3038841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['ddec9e1b-df2b-4ad1-9406-8ec4bc452317'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab49da8-d56e-4b2f-869e-92ddd3038841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1161046972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62f1d98-607f-4cde-89f6-9de078087345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f07e4f6eb5f4c92bdf9316fc0a33ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0aa1c94-235d-4641-aaa1-de34786444bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:42:56Z,use_quota=True,user_id='f7fa211a4d38416db8f02c14f17e6603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c42b8-a2b8-4484-aea7-e0d8c4da3cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c42b8-a2b8-4484-aea7-e0d8c4da3cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed81480-63b3-4230-be03-846926c6c00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed81480-63b3-4230-be03-846926c6c00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd62f1d98-607f-4cde-89f6-9de078087345', 'volume_name': 'volume-d62f1d98-607f-4cde-89f6-9de078087345', 'volume_size': 1, 'snapshot_id': 'c0aa1c94-235d-4641-aaa1-de34786444bf'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d6ae50-42b2-4029-86c7-b8b13197f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d6ae50-42b2-4029-86c7-b8b13197f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35271b32-f877-41de-852d-ea5b1f368a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:42:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Volume d62f1d98-607f-4cde-89f6-9de078087345: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d62f1d98-607f-4cde-89f6-9de078087345', 'volume_size': 1, 'snapshot_id': 'c0aa1c94-235d-4641-aaa1-de34786444bf'} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-quobyte-c0aa1c94-235d-4641-aaa1-de34786444bf-d62f1d98-607f-4cde-89f6-9de078087345" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:56 devstack cinder-volume[93772]: WARNING cinder.quota [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-640515189 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-640515189, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-c0aa1c94-235d-4641-aaa1-de34786444bf-d62f1d98-607f-4cde-89f6-9de078087345" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Creating volume d62f1d98-607f-4cde-89f6-9de078087345 from snapshot c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-quobyte-d62f1d98-607f-4cde-89f6-9de078087345" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Created reservations ['573157f3-b9f9-4f2e-a9b9-bd640f3695d5', 'c0259e0f-ee7a-4551-ad21-2ffd38d9fddf', '8ed424b2-6851-4660-af54-ed0c19dbb9ef', '357e9994-f3bd-4e27-b4f8-7811d7658dea'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-d62f1d98-607f-4cde-89f6-9de078087345" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] snapshot: c0aa1c94-235d-4641-aaa1-de34786444bf, volume: d62f1d98-607f-4cde-89f6-9de078087345, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd515e-391f-44c2-bb91-f77ca06d3763]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:42:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:56 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf Jun 27 04:42:56 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:56 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:42:56 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:57 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.904s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:42:57 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2affc856-d73f-483d-89b3-466c30b74e9f tempest-GroupSnapshotsTest-1017936661 None] Delete group completed successfully. Jun 27 04:42:57 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf" returned: 0 in 1.213s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c358e38a-44e3-4d6a-88a4-25fda8cb959b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:42:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:57 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:42:57 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:42:58 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Jun 27 04:42:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 1.060s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:42:58 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:42:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:42:58 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 Jun 27 04:42:58 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Flow 'volume_create_manager' (8d56f8ad-dce7-4761-ac73-e592b6d9847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d904b3-a631-441c-a36a-ae78d186ba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d904b3-a631-441c-a36a-ae78d186ba8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-766938995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90822dc2642455682d800001c0516bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:01Z,use_quota=True,user_id='9a009f62b19a4a38bd48bd8cb0652538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706851ed-778c-4237-8442-71ce73c8c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706851ed-778c-4237-8442-71ce73c8c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160dd67e-560b-4ab2-8512-430b78af0ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160dd67e-560b-4ab2-8512-430b78af0ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a1dcd4-d369-4d36-adc0-a75f4e8e8b54', 'volume_name': 'volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23933e3c-9a75-4a34-8979-2fab2d6a0a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23933e3c-9a75-4a34-8979-2fab2d6a0a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8d87fe-db16-4687-96f2-da7d7d74817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Volume d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54', 'volume_size': 1} Jun 27 04:43:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:05 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345" returned: 0 in 6.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b042a6-47b2-4934-a00f-a1d7ee8baaf6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:05 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:43:05 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:06 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 1.130s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:06 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:43:06 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Converted 1024.00 MB image at 150.18 MB/s Jun 27 04:43:06 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 is being set with open permissions: ugo+rw Jun 27 04:43:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:06 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 Jun 27 04:43:06 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cbfa3156-abe3-49c3-84c4-50c441d7a9dd tempest-GroupsTest-1669482538 None] Group tempest-Group1-1667047790: creating Jun 27 04:43:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cbfa3156-abe3-49c3-84c4-50c441d7a9dd tempest-GroupsTest-1669482538 None] Group tempest-Group1-1667047790: created successfully Jun 27 04:43:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cbfa3156-abe3-49c3-84c4-50c441d7a9dd tempest-GroupsTest-1669482538 None] Create group completed successfully. Jun 27 04:43:07 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345" returned: 0 in 0.719s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-d62f1d98-607f-4cde-89f6-9de078087345" released by "_copy_volume_from_snapshot" :: held 11.089s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-c0aa1c94-235d-4641-aaa1-de34786444bf-d62f1d98-607f-4cde-89f6-9de078087345" released by "_create_volume_from_snapshot" :: held 11.133s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.157s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.491s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace44fd-cc28-400b-b55d-4acd152dbc9e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35271b32-f877-41de-852d-ea5b1f368a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62f1d98-607f-4cde-89f6-9de078087345', 'volume_size': 1, 'snapshot_id': 'c0aa1c94-235d-4641-aaa1-de34786444bf'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3f1a3c-e2d7-4bc3-8ebd-8bc4dd386cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:07 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Volume volume-d62f1d98-607f-4cde-89f6-9de078087345 (d62f1d98-607f-4cde-89f6-9de078087345): created successfully Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3f1a3c-e2d7-4bc3-8ebd-8bc4dd386cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Flow 'volume_create_manager' (2f379fb2-4dd9-40db-adad-657e034d11aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0a4da286-658e-41c8-a911-1cbb8068c17b tempest-VolumeDependencyTests-91900247 None] Created volume successfully. Jun 27 04:43:07 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 Jun 27 04:43:07 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:08 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1" returned: 0 in 0.903s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.934s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.799s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-766938995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90822dc2642455682d800001c0516bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:01Z,use_quota=True,user_id='9a009f62b19a4a38bd48bd8cb0652538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Creating volume d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:43:08 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9a94b662-efd0-47d4-b57b-60797bdcc2ea tempest-GroupsTest-1669482538 None] Group tempest-Group2-541204035: creating Jun 27 04:43:08 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 1073741824 Jun 27 04:43:08 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-24b19901-2577-4ecf-8394-ce33c88978c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b0570ef-a0dd-454d-ae0d-d0a757766938', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:43:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9a94b662-efd0-47d4-b57b-60797bdcc2ea tempest-GroupsTest-1669482538 None] Group tempest-Group2-541204035: created successfully Jun 27 04:43:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9a94b662-efd0-47d4-b57b-60797bdcc2ea tempest-GroupsTest-1669482538 None] Create group completed successfully. Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-c0aa1c94-235d-4641-aaa1-de34786444bf-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-c0aa1c94-235d-4641-aaa1-de34786444bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-quobyte-49a818eb-e3c7-4a59-9330-aeb7cad3a624" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-49a818eb-e3c7-4a59-9330-aeb7cad3a624" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-quobyte-c0aa1c94-235d-4641-aaa1-de34786444bf" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-26c8c5b2-6c46-49e3-9aa4-f270a66ea45c req-fd487b46-813d-4b24-a06f-9e222d52f811 tempest-TestServerVolumeAttachmentScenario-987619019 None] attachment_update completed successfully. Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-c0aa1c94-235d-4641-aaa1-de34786444bf" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Deleting offline snapshot c0aa1c94-235d-4641-aaa1-de34786444bf of volume 49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] snapshot_file for this snap is: volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d61925-3780-444b-84d5-79f3f32aab5e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:08 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf Jun 27 04:43:08 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:09 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 1073741824" returned: 0 in 1.046s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:09 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:43:09 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:09 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf" returned: 0 in 0.984s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:43:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a81c6-f9a8-4da1-8bff-b3ac3bdd2b0d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:09 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:43:09 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Flow 'volume_create_manager' (5832596c-cbf9-4aa8-90af-b1ccc692f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c65955-937c-4d9e-b5a0-3cd12a188047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c65955-937c-4d9e-b5a0-3cd12a188047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-793778133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=125fb600-d3cb-4b74-bad3-d3a409cd0340,host='devstack@QuobyteHD#QuobyteHD',id=b9e78e85-9cc3-4335-8d27-95e517d8f914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427a0ba74b247b0a0a002e66407ce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:10Z,use_quota=True,user_id='e0a86780229847a8a2cd18b318ebfb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da24e4a9-6fbd-4fde-9829-9a1c988ca092),volume_type_id=da24e4a9-6fbd-4fde-9829-9a1c988ca092)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe40870c-0009-41ae-b396-8ba902a76006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe40870c-0009-41ae-b396-8ba902a76006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e1f962-b7ab-4249-8497-c7c8ad4a70d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e1f962-b7ab-4249-8497-c7c8ad4a70d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e78e85-9cc3-4335-8d27-95e517d8f914', 'volume_name': 'volume-b9e78e85-9cc3-4335-8d27-95e517d8f914', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a04668-1a43-4300-9a31-7d3baead168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a04668-1a43-4300-9a31-7d3baead168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877704ef-dc39-4c62-8be9-2a1a19c0571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:10 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Volume b9e78e85-9cc3-4335-8d27-95e517d8f914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e78e85-9cc3-4335-8d27-95e517d8f914', 'volume_size': 1} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:10 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.961s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.077s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=125fb600-d3cb-4b74-bad3-d3a409cd0340,created_at=2026-06-27T02:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-793778133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=125fb600-d3cb-4b74-bad3-d3a409cd0340,host='devstack@QuobyteHD#QuobyteHD',id=b9e78e85-9cc3-4335-8d27-95e517d8f914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427a0ba74b247b0a0a002e66407ce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:10Z,use_quota=True,user_id='e0a86780229847a8a2cd18b318ebfb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da24e4a9-6fbd-4fde-9829-9a1c988ca092),volume_type_id=da24e4a9-6fbd-4fde-9829-9a1c988ca092)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Creating volume b9e78e85-9cc3-4335-8d27-95e517d8f914 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:43:10 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:10 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 1073741824 Jun 27 04:43:10 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8d87fe-db16-4687-96f2-da7d7d74817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d076b8-221d-42e2-953b-6ab12d7827c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:10 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Volume volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 (d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54): created successfully Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d076b8-221d-42e2-953b-6ab12d7827c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Flow 'volume_create_manager' (8d56f8ad-dce7-4761-ac73-e592b6d9847b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:10 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-53ce26ea-0f4f-4dfe-b71f-e5c6c16bf683 tempest-VolumesActionsTest-388163240 None] Created volume successfully. Jun 27 04:43:10 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 1.164s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:10 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf Jun 27 04:43:10 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:11 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 1073741824" returned: 0 in 0.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:11 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 Jun 27 04:43:11 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:11 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf" returned: 0 in 0.894s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:11 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf Jun 27 04:43:11 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:12 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914" returned: 0 in 0.851s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877704ef-dc39-4c62-8be9-2a1a19c0571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e78e85-9cc3-4335-8d27-95e517d8f914', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e28fd1-4f99-4a7b-8110-5ea3e1acd1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:12 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Volume volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 (b9e78e85-9cc3-4335-8d27-95e517d8f914): created successfully Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e28fd1-4f99-4a7b-8110-5ea3e1acd1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Flow 'volume_create_manager' (5832596c-cbf9-4aa8-90af-b1ccc692f29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:12 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-76803b49-db9c-48d7-ac1a-12917ae48083 tempest-GroupsTest-1669482538 None] Created volume successfully. Jun 27 04:43:12 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624.c0aa1c94-235d-4641-aaa1-de34786444bf" returned: 0 in 0.724s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-c0aa1c94-235d-4641-aaa1-de34786444bf" released by "_delete_snapshot" :: held 3.905s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-49a818eb-e3c7-4a59-9330-aeb7cad3a624" released by "delete_snapshot" :: held 3.949s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Created reservations ['60317787-1fbb-44ca-bfc9-1200c204cb7e', 'a11f3555-b215-4a74-9ca6-6bb95c85657f', '83073d7c-4bd7-49e2-a1da-e2bf0225d64e', '3b9faeb9-f451-43c7-99eb-247453fb8d8b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:12 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Delete snapshot completed successfully. Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-585d86a6-d2ad-4623-8d58-e72c039ff17b tempest-VolumeDependencyTests-91900247 None] Lock "cinder-c0aa1c94-235d-4641-aaa1-de34786444bf-delete_snapshot" released by "delete_snapshot" :: held 4.208s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-49a818eb-e3c7-4a59-9330-aeb7cad3a624-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-49a818eb-e3c7-4a59-9330-aeb7cad3a624-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-quobyte-49a818eb-e3c7-4a59-9330-aeb7cad3a624" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-49a818eb-e3c7-4a59-9330-aeb7cad3a624" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ec332e-d3c2-450f-957a-aa5967099e96]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:13 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:43:13 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Acquiring lock "cinder-quobyte-b9e78e85-9cc3-4335-8d27-95e517d8f914" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Lock "cinder-quobyte-b9e78e85-9cc3-4335-8d27-95e517d8f914" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63e8145-0622-42b6-a9a5-b4001a3b846c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:13 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 Jun 27 04:43:13 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:14 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 1.037s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:14 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624 Jun 27 04:43:14 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:14 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914" returned: 0 in 1.025s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:14 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914 Jun 27 04:43:14 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:14 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-49a818eb-e3c7-4a59-9330-aeb7cad3a624" returned: 0 in 0.782s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-49a818eb-e3c7-4a59-9330-aeb7cad3a624" released by "delete_volume" :: held 1.904s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Created reservations ['2c4672a5-f9ec-4bd2-9b3e-c45c0feb1234', 'bfa28a23-46f7-4097-ba8c-296411404dde', 'fdb93485-d1ab-451b-a05e-515a175739b9', 'e6e80bc5-bb0d-41c4-9c0c-3ed72c0bc897'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:15 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:15 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-d62f1d98-607f-4cde-89f6-9de078087345-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-d62f1d98-607f-4cde-89f6-9de078087345-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "cinder-quobyte-d62f1d98-607f-4cde-89f6-9de078087345" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-d62f1d98-607f-4cde-89f6-9de078087345" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b47b0-ea79-4015-9f05-ddbe5bceaac4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:15 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 Jun 27 04:43:15 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:15 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b9e78e85-9cc3-4335-8d27-95e517d8f914" returned: 0 in 0.981s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Lock "cinder-quobyte-b9e78e85-9cc3-4335-8d27-95e517d8f914" released by "delete_volume" :: held 2.076s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Created reservations ['ff63bf11-1aad-4042-a887-98be03c94484'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:15 devstack cinder-volume[93772]: WARNING cinder.quota [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-981433373 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-981433373, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:43:15 devstack cinder-volume[93772]: WARNING cinder.quota [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-981433373 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-981433373, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:43:15 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Created reservations ['d2710141-54dc-4001-a970-865510059e02', 'a789a223-9d25-48dc-9862-0b741a48ca09', 'c57b8e8f-33ef-4d20-93c4-4a4f2d950ea3', '1ab1951f-2b89-42c8-80b9-8dbfa9267b6e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:16 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:16 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:16 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.857s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Deleted volume successfully. Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b00bdc96-13b6-47d3-a877-cb88b954f8c0 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-49a818eb-e3c7-4a59-9330-aeb7cad3a624-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Created reservations ['d6295c6f-3959-4752-a81a-00273b06f458'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:16 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:16 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:16 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345" returned: 0 in 1.197s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:16 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345 Jun 27 04:43:16 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:16 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.829s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:16 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a46cd7c4-eadb-4699-9030-d25363f4934f tempest-GroupsTest-1669482538 None] Delete group completed successfully. Jun 27 04:43:17 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.753s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:17 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-39d0a1c5-333c-4c60-afa0-7dcb17a399cc tempest-GroupsTest-1669482538 None] Delete group completed successfully. Jun 27 04:43:17 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d62f1d98-607f-4cde-89f6-9de078087345" returned: 0 in 0.800s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-quobyte-d62f1d98-607f-4cde-89f6-9de078087345" released by "delete_volume" :: held 2.050s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Created reservations ['c2c90e56-3383-4310-bb55-5c7698829186', '0c73cd01-ee3b-4976-9866-5e10fd15b002', 'f4e321b3-e6fe-4eaf-aa99-c62f9e0b884e', 'd083dd8d-4743-4632-b95c-b8ae0aa7be8b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:17 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:17 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bdf8484a-15e0-4d25-a853-2188a8208ab1 tempest-GroupsTest-1669482538 None] Group tempest-GroupsTest-Group-686415056: creating Jun 27 04:43:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bdf8484a-15e0-4d25-a853-2188a8208ab1 tempest-GroupsTest-1669482538 None] Group tempest-GroupsTest-Group-686415056: created successfully Jun 27 04:43:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bdf8484a-15e0-4d25-a853-2188a8208ab1 tempest-GroupsTest-1669482538 None] Create group completed successfully. Jun 27 04:43:18 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.748s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:18 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Deleted volume successfully. Jun 27 04:43:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-64557d30-c821-4157-9fb0-114224cf1aa9 tempest-VolumeDependencyTests-91900247 None] Lock "cinder-d62f1d98-607f-4cde-89f6-9de078087345-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Flow 'volume_create_manager' (05f8c752-63c5-43ed-837b-d3f1bc3af890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d71704-e030-4fa4-ad92-de8a07749213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d71704-e030-4fa4-ad92-de8a07749213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1705515141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c3bc194-3308-4625-b5fe-b34c90d3ba56,host='devstack@QuobyteHD#QuobyteHD',id=7e6c8688-02b7-468d-a9a6-20d81b2c865d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427a0ba74b247b0a0a002e66407ce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:20Z,use_quota=True,user_id='e0a86780229847a8a2cd18b318ebfb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c021de2-858a-47c0-8ca4-4c74bd5c5eed),volume_type_id=0c021de2-858a-47c0-8ca4-4c74bd5c5eed)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f461d105-4388-4d89-8116-8089e5f3e8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f461d105-4388-4d89-8116-8089e5f3e8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2dd370-cf30-4ea6-af33-449dc50e9550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2dd370-cf30-4ea6-af33-449dc50e9550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6c8688-02b7-468d-a9a6-20d81b2c865d', 'volume_name': 'volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715505bc-0880-48d0-a899-08cadd17f69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715505bc-0880-48d0-a899-08cadd17f69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34bab30-ca2d-495b-8de6-b4124652586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:20 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Volume 7e6c8688-02b7-468d-a9a6-20d81b2c865d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d', 'volume_size': 1} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c3bc194-3308-4625-b5fe-b34c90d3ba56,created_at=2026-06-27T02:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1705515141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c3bc194-3308-4625-b5fe-b34c90d3ba56,host='devstack@QuobyteHD#QuobyteHD',id=7e6c8688-02b7-468d-a9a6-20d81b2c865d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427a0ba74b247b0a0a002e66407ce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:20Z,use_quota=True,user_id='e0a86780229847a8a2cd18b318ebfb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c021de2-858a-47c0-8ca4-4c74bd5c5eed),volume_type_id=0c021de2-858a-47c0-8ca4-4c74bd5c5eed)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Creating volume 7e6c8688-02b7-468d-a9a6-20d81b2c865d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:43:20 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:20 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d 1073741824 Jun 27 04:43:20 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:20 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:20 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:21 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.860s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:21 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d 1073741824" returned: 0 in 1.191s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:21 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d Jun 27 04:43:21 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:22 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d" returned: 0 in 0.701s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.911s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34bab30-ca2d-495b-8de6-b4124652586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ca3cb-f043-4fad-8ee9-c503157c5523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370235e-fe60-452f-a4ed-eaa02315d18e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:22 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Volume volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d (7e6c8688-02b7-468d-a9a6-20d81b2c865d): created successfully Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98ca3cb-f043-4fad-8ee9-c503157c5523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Flow 'volume_create_manager' (05f8c752-63c5-43ed-837b-d3f1bc3af890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:22 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1f2a1de2-8770-43ae-9691-595e47020d43 tempest-GroupsTest-1669482538 None] Created volume successfully. Jun 27 04:43:22 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e Jun 27 04:43:22 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:23 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e" returned: 0 in 0.924s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-9801009f-f118-4006-a561-36628341107e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58d0a7dc-d6c8-403e-a8fd-04b30fd8d1c7', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:43:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-7c173838-d04a-4d7c-bc1f-551d8939ec05 req-026987b4-9e8d-40be-acd4-def8750eb381 tempest-TestServerVolumeAttachmentScenario-987619019 None] attachment_update completed successfully. Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Flow 'volume_create_manager' (b7fa0ce4-e530-46cf-aad6-072ba704fe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2798ca2-ab27-4d65-b0ad-ef6ed332d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2798ca2-ab27-4d65-b0ad-ef6ed332d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-649233878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c3bc194-3308-4625-b5fe-b34c90d3ba56,host='devstack@QuobyteHD#QuobyteHD',id=5e42bafd-c980-4805-bb8e-702087eac834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427a0ba74b247b0a0a002e66407ce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:24Z,use_quota=True,user_id='e0a86780229847a8a2cd18b318ebfb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c021de2-858a-47c0-8ca4-4c74bd5c5eed),volume_type_id=0c021de2-858a-47c0-8ca4-4c74bd5c5eed)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4bb667-4009-4415-a4d6-4556266216dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4bb667-4009-4415-a4d6-4556266216dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee23364f-a26e-4e13-905f-c1e2bf42a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee23364f-a26e-4e13-905f-c1e2bf42a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e42bafd-c980-4805-bb8e-702087eac834', 'volume_name': 'volume-5e42bafd-c980-4805-bb8e-702087eac834', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a762f0-d0a1-433d-baeb-e900d4018229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a762f0-d0a1-433d-baeb-e900d4018229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f21c322-c534-40cf-85e9-d7ca7546c2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:23 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Volume 5e42bafd-c980-4805-bb8e-702087eac834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e42bafd-c980-4805-bb8e-702087eac834', 'volume_size': 1} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c3bc194-3308-4625-b5fe-b34c90d3ba56,created_at=2026-06-27T02:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-649233878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c3bc194-3308-4625-b5fe-b34c90d3ba56,host='devstack@QuobyteHD#QuobyteHD',id=5e42bafd-c980-4805-bb8e-702087eac834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427a0ba74b247b0a0a002e66407ce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:24Z,use_quota=True,user_id='e0a86780229847a8a2cd18b318ebfb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c021de2-858a-47c0-8ca4-4c74bd5c5eed),volume_type_id=0c021de2-858a-47c0-8ca4-4c74bd5c5eed)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Creating volume 5e42bafd-c980-4805-bb8e-702087eac834 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:43:23 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:43:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:23 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 1073741824 Jun 27 04:43:23 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:24 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 1073741824" returned: 0 in 0.997s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:24 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 Jun 27 04:43:24 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:25 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834" returned: 0 in 0.694s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f21c322-c534-40cf-85e9-d7ca7546c2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e42bafd-c980-4805-bb8e-702087eac834', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bee6de0-5f41-46b8-9272-d854946f59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:25 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Volume volume-5e42bafd-c980-4805-bb8e-702087eac834 (5e42bafd-c980-4805-bb8e-702087eac834): created successfully Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bee6de0-5f41-46b8-9272-d854946f59ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Flow 'volume_create_manager' (b7fa0ce4-e530-46cf-aad6-072ba704fe33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:25 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c655114e-4301-4485-9008-8e13028305ca tempest-GroupsTest-1669482538 None] Created volume successfully. Jun 27 04:43:26 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-63250dff-cf31-4ad8-9aac-dce4bc505095 tempest-GroupsTest-1669482538 None] Update group completed successfully. Jun 27 04:43:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2fd21a07-3a00-4748-bc21-d415ddd1746d tempest-GroupsTest-1669482538 None] Update group completed successfully. Jun 27 04:43:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Acquiring lock "cinder-quobyte-5e42bafd-c980-4805-bb8e-702087eac834" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Lock "cinder-quobyte-5e42bafd-c980-4805-bb8e-702087eac834" acquired by "delete_volume" :: waited 0.065s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5eae3a-709b-4163-87fe-ea4b55226ece]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:30 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 Jun 27 04:43:30 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-f82b8887-ccf5-45ec-865c-68920bfa0b11 req-78215458-9e0e-4b01-abec-e6f32d5086fb tempest-TestServerVolumeAttachmentScenario-987619019 None] Terminate volume connection completed successfully. Jun 27 04:43:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-f82b8887-ccf5-45ec-865c-68920bfa0b11 req-78215458-9e0e-4b01-abec-e6f32d5086fb tempest-TestServerVolumeAttachmentScenario-987619019 None] Deleting attachment 58d0a7dc-d6c8-403e-a8fd-04b30fd8d1c7. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:43:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0e63ca97-158b-4c7d-a9a7-283dd6ff7f6a tempest-VolumesActionsTest-388163240 None] Acquiring lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" by "attach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0e63ca97-158b-4c7d-a9a7-283dd6ff7f6a tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" acquired by "attach_volume" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0e63ca97-158b-4c7d-a9a7-283dd6ff7f6a tempest-VolumesActionsTest-388163240 None] Attaching volume d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 to instance 6df5e00c-5cf9-4588-a2ef-ab5dedd07b8f at mountpoint /dev/vdb on host None. Jun 27 04:43:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0e63ca97-158b-4c7d-a9a7-283dd6ff7f6a tempest-VolumesActionsTest-388163240 None] Attach volume completed successfully. Jun 27 04:43:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0e63ca97-158b-4c7d-a9a7-283dd6ff7f6a tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" released by "attach_volume" :: held 0.179s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:31 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834" returned: 0 in 1.399s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:31 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834 Jun 27 04:43:31 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0792cb10-04ec-4acf-88be-9bb460ce5da7 tempest-VolumesActionsTest-388163240 None] Acquiring lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-detach_volume" by "detach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0792cb10-04ec-4acf-88be-9bb460ce5da7 tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0792cb10-04ec-4acf-88be-9bb460ce5da7 tempest-VolumesActionsTest-388163240 None] Detaching volume d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 from instance 6df5e00c-5cf9-4588-a2ef-ab5dedd07b8f. Jun 27 04:43:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0792cb10-04ec-4acf-88be-9bb460ce5da7 tempest-VolumesActionsTest-388163240 None] Detach volume completed successfully. Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0792cb10-04ec-4acf-88be-9bb460ce5da7 tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-detach_volume" released by "detach_volume" :: held 0.184s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:32 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5e42bafd-c980-4805-bb8e-702087eac834" returned: 0 in 1.287s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Lock "cinder-quobyte-5e42bafd-c980-4805-bb8e-702087eac834" released by "delete_volume" :: held 2.802s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Acquiring lock "cinder-quobyte-7e6c8688-02b7-468d-a9a6-20d81b2c865d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Lock "cinder-quobyte-7e6c8688-02b7-468d-a9a6-20d81b2c865d" acquired by "delete_volume" :: waited 0.037s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1d948d-3a1c-418d-b881-c1043a238954]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:33 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d Jun 27 04:43:33 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:34 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d" returned: 0 in 1.564s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:34 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d Jun 27 04:43:34 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-3f7aad23-d10a-479e-bd6a-508e64a4b4e1 req-28136151-6a4b-4b50-86d0-1cc75811649b tempest-TestServerVolumeAttachmentScenario-987619019 None] Terminate volume connection completed successfully. Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-3f7aad23-d10a-479e-bd6a-508e64a4b4e1 req-28136151-6a4b-4b50-86d0-1cc75811649b tempest-TestServerVolumeAttachmentScenario-987619019 None] Deleting attachment 6b0570ef-a0dd-454d-ae0d-d0a757766938. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:43:35 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7e6c8688-02b7-468d-a9a6-20d81b2c865d" returned: 0 in 0.923s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Lock "cinder-quobyte-7e6c8688-02b7-468d-a9a6-20d81b2c865d" released by "delete_volume" :: held 2.588s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Created reservations ['253f3ca5-fae4-4583-b500-1ca75fbc392d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:35 devstack cinder-volume[93772]: WARNING cinder.quota [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-252130003 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-252130003, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:43:35 devstack cinder-volume[93772]: WARNING cinder.quota [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-252130003 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-252130003, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Created reservations ['032c302a-dba0-4f11-829a-50477db7c849', '90927300-5ae0-4a0a-8b53-8d13ce4e449b', '7e4a14d5-69b2-48fb-ad3c-646d6bcb19cc', '010afcf2-b346-4a29-8ce7-07f1fca0dc9b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Created reservations ['a7a24398-8c39-407b-b841-565493d4cb0c', 'df65d3bd-e517-4be8-89d9-1c9425d5769b', '4e1a0748-b0ff-4d14-ae1f-7c79f5a04aa4', '8495db0c-2dd2-4e6f-9941-eeead15095b4'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:36 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:36 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:36 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.851s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e2cb40fd-2cc8-4242-9dd2-5c59648cdd9f tempest-GroupsTest-1669482538 None] Delete group completed successfully. Jun 27 04:43:45 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=96,cinder:INSERT=18,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:43:45 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=101,cinder:UPDATE=94,cinder:INSERT=25,cinder:DELETE=2 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:43:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "cinder-9801009f-f118-4006-a561-36628341107e-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-9801009f-f118-4006-a561-36628341107e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "cinder-quobyte-9801009f-f118-4006-a561-36628341107e" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-quobyte-9801009f-f118-4006-a561-36628341107e" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ddd69-949a-4381-9d40-ed1347fe18db]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:47 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e Jun 27 04:43:47 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:48 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e" returned: 0 in 1.001s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:48 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e Jun 27 04:43:48 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:49 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9801009f-f118-4006-a561-36628341107e" returned: 0 in 0.934s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-quobyte-9801009f-f118-4006-a561-36628341107e" released by "delete_volume" :: held 2.007s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Created reservations ['a66d90a1-df69-40c1-b9b8-fe50c5e68c8a', '9265d2f9-1ed4-4ecc-99f5-0481fae5f556', '0c036b31-6733-4ad2-b484-02211ca9f26c', '471a454e-cd2d-4161-a907-52ba4bd14622'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:49 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:49 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "cinder-24b19901-2577-4ecf-8394-ce33c88978c1-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-24b19901-2577-4ecf-8394-ce33c88978c1-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "cinder-quobyte-24b19901-2577-4ecf-8394-ce33c88978c1" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-quobyte-24b19901-2577-4ecf-8394-ce33c88978c1" acquired by "delete_volume" :: waited 0.043s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb164c64-8150-4405-bccb-187051f4e5da]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:50 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 Jun 27 04:43:50 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Flow 'volume_create_manager' (f9ab3caf-4376-4a57-9aa4-c92b19c8c367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f673f8a3-9f23-44c0-a7bd-6b4f0cb555a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f673f8a3-9f23-44c0-a7bd-6b4f0cb555a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1699966876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420af888-7e9b-4cb4-a271-248eed309bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f295e973ae4a2ca803f2a7e42c2775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:50Z,use_quota=True,user_id='6f950da259334c679ce19e739a60a874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532f4561-73e4-4145-b813-66f2c9b67e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532f4561-73e4-4145-b813-66f2c9b67e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b1d10d-633b-456f-9dda-2e94e4584401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b1d10d-633b-456f-9dda-2e94e4584401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420af888-7e9b-4cb4-a271-248eed309bbe', 'volume_name': 'volume-420af888-7e9b-4cb4-a271-248eed309bbe', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da0f968-c196-4055-9263-b3c7d1e29222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da0f968-c196-4055-9263-b3c7d1e29222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df380495-3b3e-4ab8-95ba-63d5f32bbf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Volume 420af888-7e9b-4cb4-a271-248eed309bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420af888-7e9b-4cb4-a271-248eed309bbe', 'volume_size': 1} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1699966876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420af888-7e9b-4cb4-a271-248eed309bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f295e973ae4a2ca803f2a7e42c2775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:50Z,use_quota=True,user_id='6f950da259334c679ce19e739a60a874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Creating volume 420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:43:50 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:43:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:50 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe 1073741824 Jun 27 04:43:50 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:51 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.594s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:51 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Deleted volume successfully. Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1" returned: 0 in 1.189s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:51 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1 Jun 27 04:43:51 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e0a22143-42c5-4491-b29e-1af300f0f0c0 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-9801009f-f118-4006-a561-36628341107e-delete_volume" released by "delete_volume" :: held 3.996s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:51 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe 1073741824" returned: 0 in 1.213s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:52 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:43:52 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:52 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-24b19901-2577-4ecf-8394-ce33c88978c1" returned: 0 in 0.861s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-quobyte-24b19901-2577-4ecf-8394-ce33c88978c1" released by "delete_volume" :: held 2.136s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Created reservations ['f65fb35e-1572-46f0-9d74-66807251c86c', '877246fd-f39f-46ad-beba-465b88901d68', 'f16e0348-8c77-48ef-a826-c2e84dba750d', '1eaae00d-a74d-4726-b0fc-5303d23684a3'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:52 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:43:52 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:52 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 0.961s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df380495-3b3e-4ab8-95ba-63d5f32bbf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420af888-7e9b-4cb4-a271-248eed309bbe', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f639600-e660-4dcb-abfb-568756619007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:53 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Volume volume-420af888-7e9b-4cb4-a271-248eed309bbe (420af888-7e9b-4cb4-a271-248eed309bbe): created successfully Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f639600-e660-4dcb-abfb-568756619007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Flow 'volume_create_manager' (f9ab3caf-4376-4a57-9aa4-c92b19c8c367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e655e973-dd27-440e-a34d-1522b18cbe16 tempest-SnapshotDependencyTests-1108349051 None] Created volume successfully. Jun 27 04:43:53 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.771s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:43:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Deleted volume successfully. Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a7557274-b2ff-4fb4-99d5-45310ca07307 tempest-TestServerVolumeAttachmentScenario-987619019 None] Lock "cinder-24b19901-2577-4ecf-8394-ce33c88978c1-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Creating offline snapshot 52910674-9e84-4eed-a38c-10d9047cd3a0 of volume 420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[05014459-6439-4a5c-b6bd-45c98c168672]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:43:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:54 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:43:54 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:54 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 1.105s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:54 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 1G Jun 27 04:43:54 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:55 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 1G" returned: 0 in 0.987s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420af888-7e9b-4cb4-a271-248eed309bbe -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:55 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420af888-7e9b-4cb4-a271-248eed309bbe -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 Jun 27 04:43:55 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:56 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420af888-7e9b-4cb4-a271-248eed309bbe -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0" returned: 0 in 0.941s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:56 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 is being set with open permissions: ugo+rw Jun 27 04:43:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:56 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 Jun 27 04:43:56 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Flow 'volume_create_manager' (70c69702-0f4f-44af-8328-b9c6908bec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba203e4-a84d-45c7-bcf0-fe498a7bbbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba203e4-a84d-45c7-bcf0-fe498a7bbbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1402969803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d719a9-f885-4844-861a-216d5d4b53bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7abade0aed4b55a953283cc96a5cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:57Z,use_quota=True,user_id='c86d17a71a63478389018e0f95ca5c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad8a60e-16e8-468e-ac1e-13dacd3e9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad8a60e-16e8-468e-ac1e-13dacd3e9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958da2af-04b9-447c-ac46-9f4817076b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958da2af-04b9-447c-ac46-9f4817076b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d719a9-f885-4844-861a-216d5d4b53bb', 'volume_name': 'volume-77d719a9-f885-4844-861a-216d5d4b53bb', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197d8913-606b-4245-b1c5-c925dc3b4687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197d8913-606b-4245-b1c5-c925dc3b4687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d6da8d-11fb-483c-89cc-91c33d9c283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:43:57 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Volume 77d719a9-f885-4844-861a-216d5d4b53bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d719a9-f885-4844-861a-216d5d4b53bb', 'volume_size': 1} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:43:57 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0" returned: 0 in 0.908s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:57 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info Jun 27 04:43:57 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:43:58 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Jun 27 04:43:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info" returned: 0 in 1.073s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:43:58 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info is being set with open permissions: ugo+rw Jun 27 04:43:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:43:58 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info Jun 27 04:43:58 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:00 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.info" returned: 0 in 1.159s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.311s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.648s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1402969803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d719a9-f885-4844-861a-216d5d4b53bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7abade0aed4b55a953283cc96a5cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:43:57Z,use_quota=True,user_id='c86d17a71a63478389018e0f95ca5c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Creating volume 77d719a9-f885-4844-861a-216d5d4b53bb {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:00 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:00 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb 1073741824 Jun 27 04:44:00 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-af6f4305-1abc-4b6c-8ac6-f0cfe935294b tempest-SnapshotDependencyTests-1108349051 None] Create snapshot completed successfully Jun 27 04:44:01 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb 1073741824" returned: 0 in 1.703s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:02 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb Jun 27 04:44:02 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ccfcc221-1f8e-4ed6-8587-c704ad315fcb tempest-VolumesActionsTest-388163240 None] Acquiring lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" by "attach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ccfcc221-1f8e-4ed6-8587-c704ad315fcb tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" acquired by "attach_volume" :: waited 0.059s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ccfcc221-1f8e-4ed6-8587-c704ad315fcb tempest-VolumesActionsTest-388163240 None] Attaching volume d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 to instance 7782b16e-3011-4460-b28d-7d0449edfc56 at mountpoint /dev/vdb on host None. Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Flow 'volume_create_manager' (e443eaaf-0cf7-4dda-9c14-52b024abcff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad6b42a-d765-4dae-b26e-b137ff86ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad6b42a-d765-4dae-b26e-b137ff86ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf06cbd-72cf-489f-a0e5-73440a2778df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f295e973ae4a2ca803f2a7e42c2775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52910674-9e84-4eed-a38c-10d9047cd3a0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:03Z,use_quota=True,user_id='6f950da259334c679ce19e739a60a874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f7618d-d97b-4185-8a5e-50f4fc5d94fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f7618d-d97b-4185-8a5e-50f4fc5d94fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae155fd1-2774-4d7c-9352-f3d75f94d465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae155fd1-2774-4d7c-9352-f3d75f94d465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bdf06cbd-72cf-489f-a0e5-73440a2778df', 'volume_name': 'volume-bdf06cbd-72cf-489f-a0e5-73440a2778df', 'volume_size': 1, 'snapshot_id': '52910674-9e84-4eed-a38c-10d9047cd3a0'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7bb047-18a5-4c8d-b1ac-287652735c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7bb047-18a5-4c8d-b1ac-287652735c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb17f52-473e-40fe-8ad3-5e5b753c007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:02 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Volume bdf06cbd-72cf-489f-a0e5-73440a2778df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bdf06cbd-72cf-489f-a0e5-73440a2778df', 'volume_size': 1, 'snapshot_id': '52910674-9e84-4eed-a38c-10d9047cd3a0'} Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ccfcc221-1f8e-4ed6-8587-c704ad315fcb tempest-VolumesActionsTest-388163240 None] Attach volume completed successfully. Jun 27 04:44:02 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ccfcc221-1f8e-4ed6-8587-c704ad315fcb tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" released by "attach_volume" :: held 0.346s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:03 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb" returned: 0 in 1.273s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] <== create_volume: return (3095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.104s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.356s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-quobyte-52910674-9e84-4eed-a38c-10d9047cd3a0-bdf06cbd-72cf-489f-a0e5-73440a2778df" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d6da8d-11fb-483c-89cc-91c33d9c283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d719a9-f885-4844-861a-216d5d4b53bb', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a396d71-1ae6-4792-8bf2-7f280b6eeb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-52910674-9e84-4eed-a38c-10d9047cd3a0-bdf06cbd-72cf-489f-a0e5-73440a2778df" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Creating volume bdf06cbd-72cf-489f-a0e5-73440a2778df from snapshot 52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-quobyte-bdf06cbd-72cf-489f-a0e5-73440a2778df" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-031a9b04-6e82-4779-8da8-68156d9a79ae tempest-VolumesActionsTest-388163240 None] Acquiring lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-detach_volume" by "detach_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:03 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Volume volume-77d719a9-f885-4844-861a-216d5d4b53bb (77d719a9-f885-4844-861a-216d5d4b53bb): created successfully Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a396d71-1ae6-4792-8bf2-7f280b6eeb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Flow 'volume_create_manager' (70c69702-0f4f-44af-8328-b9c6908bec4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-031a9b04-6e82-4779-8da8-68156d9a79ae tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-031a9b04-6e82-4779-8da8-68156d9a79ae tempest-VolumesActionsTest-388163240 None] Detaching volume d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 from instance 7782b16e-3011-4460-b28d-7d0449edfc56. Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-bdf06cbd-72cf-489f-a0e5-73440a2778df" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] snapshot: 52910674-9e84-4eed-a38c-10d9047cd3a0, volume: bdf06cbd-72cf-489f-a0e5-73440a2778df, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:44:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5064044e-98ce-4005-9207-2606b2520f14 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Created volume successfully. Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3678a693-70c8-407f-8b8e-2742f9f43f61]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-031a9b04-6e82-4779-8da8-68156d9a79ae tempest-VolumesActionsTest-388163240 None] Detach volume completed successfully. Jun 27 04:44:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-031a9b04-6e82-4779-8da8-68156d9a79ae tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-detach_volume" released by "detach_volume" :: held 0.296s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:03 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 Jun 27 04:44:03 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "cinder-77d719a9-f885-4844-861a-216d5d4b53bb-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "cinder-77d719a9-f885-4844-861a-216d5d4b53bb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "cinder-quobyte-77d719a9-f885-4844-861a-216d5d4b53bb" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "cinder-quobyte-77d719a9-f885-4844-861a-216d5d4b53bb" acquired by "delete_volume" :: waited 0.036s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c432696-bc24-4f91-9f2d-179180c1acf5]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:04 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb Jun 27 04:44:04 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:04 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0" returned: 0 in 1.266s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420af888-7e9b-4cb4-a271-248eed309bbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e88fd5b-ecbd-4d0e-ab02-e4ff4f4e8774]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:04 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:44:04 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:05 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb" returned: 0 in 1.489s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:06 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb Jun 27 04:44:06 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:06 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 1.500s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:06 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:44:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:06 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df Jun 27 04:44:06 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:07 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-77d719a9-f885-4844-861a-216d5d4b53bb" returned: 0 in 1.246s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "cinder-quobyte-77d719a9-f885-4844-861a-216d5d4b53bb" released by "delete_volume" :: held 2.829s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Created reservations ['d95e6301-621d-4153-ab99-1a97b69b9c69', 'b3e9471c-2731-4f31-afd6-ddf1ac6849cb', 'aee7883c-4482-4a46-a17e-8aa60fc608d8', '1e97dda8-b38f-4380-b2ab-f85221ab04fb'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:07 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:44:07 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:09 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 2.018s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:09 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:44:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Deleted volume successfully. Jun 27 04:44:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-67662a2a-4271-48b2-8ce3-3ceed3b1022f tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "cinder-77d719a9-f885-4844-861a-216d5d4b53bb-delete_volume" released by "delete_volume" :: held 5.339s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Flow 'volume_create_manager' (82ea4fb4-8645-45e6-9f56-37a2f139c0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740ba483-6068-40be-9eb8-d6e01ea26de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740ba483-6068-40be-9eb8-d6e01ea26de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1043692900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b331d2b9-fbf3-43ec-a1f7-abf5a6408596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7abade0aed4b55a953283cc96a5cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:10Z,use_quota=True,user_id='c86d17a71a63478389018e0f95ca5c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c96814-42e2-4669-a257-b1fa471f3580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c96814-42e2-4669-a257-b1fa471f3580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eda84a7-9086-46bd-8a67-d18de717a6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eda84a7-9086-46bd-8a67-d18de717a6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b331d2b9-fbf3-43ec-a1f7-abf5a6408596', 'volume_name': 'volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7149507f-2886-480e-8171-50b84941fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7149507f-2886-480e-8171-50b84941fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e0e4c0-c446-4471-8ded-db15515c0022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:10 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Volume b331d2b9-fbf3-43ec-a1f7-abf5a6408596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596', 'volume_size': 1} Jun 27 04:44:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:13 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df" returned: 0 in 7.204s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[957e7d3b-2890-4599-afa9-a2898e68f83d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:13 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:44:13 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:14 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 1.184s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:14 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:44:14 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Converted 1024.00 MB image at 142.12 MB/s Jun 27 04:44:14 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df is being set with open permissions: ugo+rw Jun 27 04:44:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:14 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df Jun 27 04:44:14 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (94624867-7424-4853-a9c3-194dfb9a0a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d19cd72-7356-478c-a130-cacf9b43a56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df" returned: 0 in 0.677s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d19cd72-7356-478c-a130-cacf9b43a56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-788252664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be7eb87-5e1a-4296-abb0-9903be6f36c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:15Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19da1d0d-9265-42f0-8228-0ed0b91d2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19da1d0d-9265-42f0-8228-0ed0b91d2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ec3700-105e-4ba8-9eb0-9143bf8bc419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ec3700-105e-4ba8-9eb0-9143bf8bc419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be7eb87-5e1a-4296-abb0-9903be6f36c3', 'volume_name': 'volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf2e133-e512-48b8-b053-ad8d1e0b04b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf2e133-e512-48b8-b053-ad8d1e0b04b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb063e11-5bca-4129-be1c-a7097178000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Volume 0be7eb87-5e1a-4296-abb0-9903be6f36c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3', 'volume_size': 1} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-bdf06cbd-72cf-489f-a0e5-73440a2778df" released by "_copy_volume_from_snapshot" :: held 12.170s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-52910674-9e84-4eed-a38c-10d9047cd3a0-bdf06cbd-72cf-489f-a0e5-73440a2778df" released by "_create_volume_from_snapshot" :: held 12.263s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.312s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.215s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1043692900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b331d2b9-fbf3-43ec-a1f7-abf5a6408596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7abade0aed4b55a953283cc96a5cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:10Z,use_quota=True,user_id='c86d17a71a63478389018e0f95ca5c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Creating volume b331d2b9-fbf3-43ec-a1f7-abf5a6408596 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:15 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:15 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 1073741824 Jun 27 04:44:15 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb17f52-473e-40fe-8ad3-5e5b753c007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf06cbd-72cf-489f-a0e5-73440a2778df', 'volume_size': 1, 'snapshot_id': '52910674-9e84-4eed-a38c-10d9047cd3a0'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70f7d43-171c-459c-91bb-e80bcbf517a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Volume volume-bdf06cbd-72cf-489f-a0e5-73440a2778df (bdf06cbd-72cf-489f-a0e5-73440a2778df): created successfully Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70f7d43-171c-459c-91bb-e80bcbf517a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Flow 'volume_create_manager' (e443eaaf-0cf7-4dda-9c14-52b024abcff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4ae32207-a956-47ec-9e53-af21a255de96 tempest-SnapshotDependencyTests-1108349051 None] Created volume successfully. Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (d2b0b5bb-ad24-40d9-9a3d-9c0eb615de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3efcc6-a082-4370-922a-5050b215b86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3efcc6-a082-4370-922a-5050b215b86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-865156578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e06944-fa46-4244-b07d-f1f285d30bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:16Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f258ccdb-1cc5-4f21-b146-471090996cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f258ccdb-1cc5-4f21-b146-471090996cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ade847-9d70-4d21-884e-1fa6a987c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ade847-9d70-4d21-884e-1fa6a987c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e06944-fa46-4244-b07d-f1f285d30bc6', 'volume_name': 'volume-e4e06944-fa46-4244-b07d-f1f285d30bc6', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526b707c-5269-41e5-934a-0740e702bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526b707c-5269-41e5-934a-0740e702bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ff6bbb-5f8e-4496-a9cb-29b7e994ae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Volume e4e06944-fa46-4244-b07d-f1f285d30bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e06944-fa46-4244-b07d-f1f285d30bc6', 'volume_size': 1} Jun 27 04:44:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (a815e8e2-02f7-49cf-8ffe-a695b17248ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57003212-21f7-4500-a92b-59bdacd7d7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-52910674-9e84-4eed-a38c-10d9047cd3a0-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57003212-21f7-4500-a92b-59bdacd7d7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057461073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:16Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894cf925-c478-42f8-bf9f-6615703a8698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894cf925-c478-42f8-bf9f-6615703a8698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb43212-8c49-4e20-94cc-d66ba1d42b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb43212-8c49-4e20-94cc-d66ba1d42b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95', 'volume_name': 'volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d186dba3-729d-4d6c-ae8a-4bf4c7fc6287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d186dba3-729d-4d6c-ae8a-4bf4c7fc6287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c19f09-1b1a-47da-94ff-a54ee6636828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Volume c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95', 'volume_size': 1} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-52910674-9e84-4eed-a38c-10d9047cd3a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-quobyte-420af888-7e9b-4cb4-a271-248eed309bbe" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-420af888-7e9b-4cb4-a271-248eed309bbe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-quobyte-52910674-9e84-4eed-a38c-10d9047cd3a0" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-52910674-9e84-4eed-a38c-10d9047cd3a0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Deleting offline snapshot 52910674-9e84-4eed-a38c-10d9047cd3a0 of volume 420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] snapshot_file for this snap is: volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f56256-f176-4b59-91b9-1131a7e5a254]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:16 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 1073741824" returned: 0 in 0.996s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:16 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 Jun 27 04:44:16 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:16 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 Jun 27 04:44:16 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (5592e51d-1ab6-4db5-bc61-0ab58d2e3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757775ac-6674-4dda-9911-a3ca57285e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757775ac-6674-4dda-9911-a3ca57285e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1841095258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ca3e30-7014-461f-94ee-f30263b6c3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:17Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77fdd74-cfd4-436b-a049-7fe84fcf5ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77fdd74-cfd4-436b-a049-7fe84fcf5ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741311a1-4a60-4de1-a3d1-859598f8d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741311a1-4a60-4de1-a3d1-859598f8d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ca3e30-7014-461f-94ee-f30263b6c3bd', 'volume_name': 'volume-29ca3e30-7014-461f-94ee-f30263b6c3bd', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c34909-9089-48fa-8e8b-202cf16ae314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c34909-9089-48fa-8e8b-202cf16ae314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5029567-7450-4c0b-ae91-07fd55acdbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:16 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Volume 29ca3e30-7014-461f-94ee-f30263b6c3bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ca3e30-7014-461f-94ee-f30263b6c3bd', 'volume_size': 1} Jun 27 04:44:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:17 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596" returned: 0 in 0.769s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.424s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:17 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e0e4c0-c446-4471-8ded-db15515c0022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228a2b99-d3f7-47fb-8c13-4493634bd513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[53da92a1-95eb-4edb-bbf5-4ebe90e8a4d4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0" returned: 0 in 0.938s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420af888-7e9b-4cb4-a271-248eed309bbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:44:17 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Volume volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 (b331d2b9-fbf3-43ec-a1f7-abf5a6408596): created successfully Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228a2b99-d3f7-47fb-8c13-4493634bd513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Flow 'volume_create_manager' (82ea4fb4-8645-45e6-9f56-37a2f139c0ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f904f1ec-b390-404d-8a6a-3a2b16c7c515]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:17 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8599fb1d-6dfa-4c3e-bffe-7c6952434538 tempest-VolumeQuotasAdminTestJSON-1666732704 None] Created volume successfully. Jun 27 04:44:17 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:44:17 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (a62b09a2-501a-4b99-8b75-f3ac7b8700d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6222cb56-f645-4f86-baea-4e1280c6862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6222cb56-f645-4f86-baea-4e1280c6862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1247412234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d642efb1-cfa4-4ed9-a775-fd14b69ebeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:17Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0119d9cc-deb1-4217-a873-bbfbdc4317d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0119d9cc-deb1-4217-a873-bbfbdc4317d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bf81f2-c743-4c50-8d0f-08f39e7a60c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bf81f2-c743-4c50-8d0f-08f39e7a60c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd642efb1-cfa4-4ed9-a775-fd14b69ebeaa', 'volume_name': 'volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678d74e9-60c9-405d-ae45-a9efb5c66e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678d74e9-60c9-405d-ae45-a9efb5c66e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd0ae46-a29c-4a4e-9648-44035133869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:17 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:44:17 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Volume d642efb1-cfa4-4ed9-a775-fd14b69ebeaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa', 'volume_size': 1} Jun 27 04:44:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:17 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:18 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.829s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520536c-2e9c-4059-82c4-13e6d0cea65b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:18 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:44:18 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:18 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 0.948s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:18 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 Jun 27 04:44:18 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:18 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-47d72415-d48b-4ac9-b753-0f7710e42e87 tempest-VolumeQuotasAdminTestJSON-928033129 None] Transfer volume completed successfully. Jun 27 04:44:19 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.946s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.0dae59ad-000b-4a8f-8c40-6c5d18ba8c3chxdekxqb.img {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:19 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.0dae59ad-000b-4a8f-8c40-6c5d18ba8c3chxdekxqb.img Jun 27 04:44:19 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:19 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0" returned: 0 in 0.864s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:19 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0 Jun 27 04:44:19 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Acquiring lock "cinder-b331d2b9-fbf3-43ec-a1f7-abf5a6408596-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Lock "cinder-b331d2b9-fbf3-43ec-a1f7-abf5a6408596-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Acquiring lock "cinder-quobyte-b331d2b9-fbf3-43ec-a1f7-abf5a6408596" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Lock "cinder-quobyte-b331d2b9-fbf3-43ec-a1f7-abf5a6408596" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a8cb61-962f-484e-aec0-c4bcc1caf434]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:19 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 Jun 27 04:44:19 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:20 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe.52910674-9e84-4eed-a38c-10d9047cd3a0" returned: 0 in 1.158s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-52910674-9e84-4eed-a38c-10d9047cd3a0" released by "_delete_snapshot" :: held 4.153s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-420af888-7e9b-4cb4-a271-248eed309bbe" released by "delete_snapshot" :: held 4.203s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:20 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:44:20 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:21 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Created reservations ['85045791-4fd2-4dec-b27c-2e0f78bfbd27', '49a38a06-3d75-4091-aeb1-99de491cb09c', '315c1902-0667-43d1-9f08-159a7bbee5fb', 'e49428fe-1110-4767-b210-10e398481fac'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:44:21 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596" returned: 0 in 1.419s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:21 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596 Jun 27 04:44:21 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Delete snapshot completed successfully. Jun 27 04:44:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2d100181-4075-4abf-9924-d60a214eabe8 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-52910674-9e84-4eed-a38c-10d9047cd3a0-delete_snapshot" released by "delete_snapshot" :: held 4.817s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-420af888-7e9b-4cb4-a271-248eed309bbe-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-420af888-7e9b-4cb4-a271-248eed309bbe-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-quobyte-420af888-7e9b-4cb4-a271-248eed309bbe" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-420af888-7e9b-4cb4-a271-248eed309bbe" acquired by "delete_volume" :: waited 0.048s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[881e6740-daff-46b2-87ba-b91a06b044c5]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:22 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b331d2b9-fbf3-43ec-a1f7-abf5a6408596" returned: 0 in 1.320s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Lock "cinder-quobyte-b331d2b9-fbf3-43ec-a1f7-abf5a6408596" released by "delete_volume" :: held 2.818s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Created reservations ['c18cb991-f212-41ed-9b3d-91f67b3b675a', '9234bd31-f219-48b2-ab26-edba4a43e7e6', '143a11ac-dd27-4e9f-bdd6-bb5ec030a274', '66e87b85-fe2f-459a-9be4-f797e15518f4'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:44:22 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.975s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:44:22 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:44:22 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:22 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:44:22 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:24 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 2.181s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:24 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe Jun 27 04:44:24 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:25 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 2.257s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:44:25 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Deleted volume successfully. Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-27379ee9-7e9c-4e62-91b8-206dca791d9b tempest-VolumeQuotasAdminTestJSON-511095628 None] Lock "cinder-b331d2b9-fbf3-43ec-a1f7-abf5a6408596-delete_volume" released by "delete_volume" :: held 5.710s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:25 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.0dae59ad-000b-4a8f-8c40-6c5d18ba8c3chxdekxqb.img" returned: 0 in 6.456s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1700f7a5-e45e-4699-ad8f-0f45b34238f2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:25 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:44:25 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:25 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-420af888-7e9b-4cb4-a271-248eed309bbe" returned: 0 in 1.462s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-420af888-7e9b-4cb4-a271-248eed309bbe" released by "delete_volume" :: held 3.800s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Created reservations ['6d0a7a7e-9196-4c16-baf3-0c41cd4f896f', '46deb57f-5c08-4870-86fd-2063310fd0f0', '4cd32ae2-1f38-4670-aed5-3c563a3b6318', '00cd8a37-9538-4c84-91a5-6a88367afb65'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:26 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:44:26 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:26 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 1.065s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.0dae59ad-000b-4a8f-8c40-6c5d18ba8c3chxdekxqb.img {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:44:26 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Converted 1024.00 MB image at 158.59 MB/s Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-bdf06cbd-72cf-489f-a0e5-73440a2778df-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] 0dae59ad-000b-4a8f-8c40-6c5d18ba8c3c was raw, no need to convert to raw {{(pid=93772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-bdf06cbd-72cf-489f-a0e5-73440a2778df-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "cinder-quobyte-bdf06cbd-72cf-489f-a0e5-73440a2778df" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-bdf06cbd-72cf-489f-a0e5-73440a2778df" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:27 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfc6aae-8f40-4d62-af99-566cd6fb5b05]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:27 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.929s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:27 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:44:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Deleted volume successfully. Jun 27 04:44:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-6374b3e6-c92e-4d98-9b96-0d570d5d9b0e tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-420af888-7e9b-4cb4-a271-248eed309bbe-delete_volume" released by "delete_volume" :: held 5.154s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:27 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df Jun 27 04:44:27 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:28 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df" returned: 0 in 1.055s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:28 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df Jun 27 04:44:28 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:28 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bdf06cbd-72cf-489f-a0e5-73440a2778df" returned: 0 in 0.833s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-quobyte-bdf06cbd-72cf-489f-a0e5-73440a2778df" released by "delete_volume" :: held 1.965s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Created reservations ['74fe7f16-d4d6-47b4-b6f7-d731da29011e', '2839c058-743c-4257-8ee4-7d196dba7821', 'bef6b0b0-d6eb-4d64-8dfb-7f05824421e2', '1a296845-e1f9-4501-b448-f78875c9eecf'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:29 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:44:29 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:30 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.844s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:30 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:44:30 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Deleted volume successfully. Jun 27 04:44:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c7b0fc19-ae70-4978-843d-183eeae48b44 tempest-SnapshotDependencyTests-1108349051 None] Lock "cinder-bdf06cbd-72cf-489f-a0e5-73440a2778df-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Flow 'volume_create_manager' (23a542f2-d371-4dcb-bb9b-192641d9af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c5672c-3524-4083-838a-a30f3bdec585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c5672c-3524-4083-838a-a30f3bdec585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-117079060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d750fb-2324-48ec-8387-e77ead919016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab269158d094ddea49e5756863f22a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:34Z,use_quota=True,user_id='df7a8ffe311e422bb9b524e9a1e4e73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cece4a-0901-4273-95e0-28998e197f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cece4a-0901-4273-95e0-28998e197f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e5457f-8e0c-4d26-9f53-b985155812e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e5457f-8e0c-4d26-9f53-b985155812e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d750fb-2324-48ec-8387-e77ead919016', 'volume_name': 'volume-f8d750fb-2324-48ec-8387-e77ead919016', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8090e169-6693-41d6-abe3-6140a5a69b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8090e169-6693-41d6-abe3-6140a5a69b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4db9031-a252-4854-8249-136b7bd3a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:33 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Volume f8d750fb-2324-48ec-8387-e77ead919016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d750fb-2324-48ec-8387-e77ead919016', 'volume_size': 1} Jun 27 04:44:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:43 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:44:43 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=63,cinder:UPDATE=65,cinder:INSERT=17,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.528s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Uploaded volume to glance image-id: 0dae59ad-000b-4a8f-8c40-6c5d18ba8c3c. {{(pid=93772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.388s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-788252664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be7eb87-5e1a-4296-abb0-9903be6f36c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:15Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Creating volume 0be7eb87-5e1a-4296-abb0-9903be6f36c3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:48 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:48 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 1073741824 Jun 27 04:44:48 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-de39521e-25a2-4048-bbfc-dc478fc92937 tempest-VolumesActionsTest-388163240 None] Copy volume to image completed successfully. Jun 27 04:44:49 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 1073741824" returned: 0 in 0.875s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:49 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 Jun 27 04:44:49 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:50 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3" returned: 0 in 0.728s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.650s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-865156578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e06944-fa46-4244-b07d-f1f285d30bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:16Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Creating volume e4e06944-fa46-4244-b07d-f1f285d30bc6 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:50 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:50 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 1073741824 Jun 27 04:44:50 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb063e11-5bca-4129-be1c-a7097178000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a760cb0-51b2-4a1f-ad07-59a406ecd7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Volume volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 (0be7eb87-5e1a-4296-abb0-9903be6f36c3): created successfully Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a760cb0-51b2-4a1f-ad07-59a406ecd7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (94624867-7424-4853-a9c3-194dfb9a0a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3598d263-487e-4475-bb70-c7aa106006e1 tempest-CreateVolumesFromImageTest-690870217 None] Created volume successfully. Jun 27 04:44:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:51 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 1073741824" returned: 0 in 0.854s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:51 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 Jun 27 04:44:51 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:52 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6" returned: 0 in 0.658s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.755s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2057461073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:16Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Creating volume c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:52 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ff6bbb-5f8e-4496-a9cb-29b7e994ae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e06944-fa46-4244-b07d-f1f285d30bc6', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d4013a-a442-4c8a-b51b-5ce4df5f1cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:52 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 1073741824 Jun 27 04:44:52 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Volume volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 (e4e06944-fa46-4244-b07d-f1f285d30bc6): created successfully Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d4013a-a442-4c8a-b51b-5ce4df5f1cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (d2b0b5bb-ad24-40d9-9a3d-9c0eb615de7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f16b9757-6311-4a6f-a8c0-8952d2b60806 tempest-CreateVolumesFromImageTest-690870217 None] Created volume successfully. Jun 27 04:44:53 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 1073741824" returned: 0 in 0.907s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:53 devstack sudo[109580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 Jun 27 04:44:53 devstack sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95" returned: 0 in 0.692s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.836s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:53 devstack sudo[109580]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1841095258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ca3e30-7014-461f-94ee-f30263b6c3bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:17Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Creating volume 29ca3e30-7014-461f-94ee-f30263b6c3bd {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:53 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:53 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd 1073741824 Jun 27 04:44:53 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c19f09-1b1a-47da-94ff-a54ee6636828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a64211-a4f5-4425-9d78-2e9ee4f5016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Volume volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 (c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95): created successfully Jun 27 04:44:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a64211-a4f5-4425-9d78-2e9ee4f5016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (a815e8e2-02f7-49cf-8ffe-a695b17248ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-59bf673d-c39a-4883-abad-e4c76f169ee7 tempest-CreateVolumesFromImageTest-690870217 None] Created volume successfully. Jun 27 04:44:54 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd 1073741824" returned: 0 in 0.888s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:54 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd Jun 27 04:44:54 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:55 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd" returned: 0 in 0.660s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 37.782s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1247412234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d642efb1-cfa4-4ed9-a775-fd14b69ebeaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0d47fb093b4f6a8f9882ddd5b87d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:17Z,use_quota=True,user_id='5e8b2976d3a64c4dace2497987703d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Creating volume d642efb1-cfa4-4ed9-a775-fd14b69ebeaa {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:55 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5029567-7450-4c0b-ae91-07fd55acdbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ca3e30-7014-461f-94ee-f30263b6c3bd', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:55 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa 1073741824 Jun 27 04:44:55 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9c9130-43dd-45b7-aa92-2cf4436088c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:55 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Volume volume-29ca3e30-7014-461f-94ee-f30263b6c3bd (29ca3e30-7014-461f-94ee-f30263b6c3bd): created successfully Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9c9130-43dd-45b7-aa92-2cf4436088c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:55 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (5592e51d-1ab6-4db5-bc61-0ab58d2e3592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:55 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a9736f3b-367a-4836-936f-3f320190878d tempest-CreateVolumesFromImageTest-690870217 None] Created volume successfully. Jun 27 04:44:56 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa 1073741824" returned: 0 in 0.895s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:56 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa Jun 27 04:44:56 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:57 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa" returned: 0 in 0.668s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.212s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-117079060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d750fb-2324-48ec-8387-e77ead919016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab269158d094ddea49e5756863f22a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:44:34Z,use_quota=True,user_id='df7a8ffe311e422bb9b524e9a1e4e73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Creating volume f8d750fb-2324-48ec-8387-e77ead919016 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:44:57 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:57 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 1073741824 Jun 27 04:44:57 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd0ae46-a29c-4a4e-9648-44035133869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da91155c-3475-422a-95a6-579378c1fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:57 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Volume volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa (d642efb1-cfa4-4ed9-a775-fd14b69ebeaa): created successfully Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da91155c-3475-422a-95a6-579378c1fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Flow 'volume_create_manager' (a62b09a2-501a-4b99-8b75-f3ac7b8700d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:57 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-59f2ee11-e4bf-4480-8fb3-dc713a20a6b3 tempest-CreateVolumesFromImageTest-690870217 None] Created volume successfully. Jun 27 04:44:57 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 1073741824" returned: 0 in 0.884s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:57 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 Jun 27 04:44:57 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-quobyte-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd207683-67bb-469c-bdb2-28620a500b53]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:58 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa Jun 27 04:44:58 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:58 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016" returned: 0 in 0.700s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.887s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4db9031-a252-4854-8249-136b7bd3a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d750fb-2324-48ec-8387-e77ead919016', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40de8242-c0d8-43f0-9670-b9bb44beaacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9283b7b8-ed40-4699-8da6-0fbc3370a6b7]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Volume volume-f8d750fb-2324-48ec-8387-e77ead919016 (f8d750fb-2324-48ec-8387-e77ead919016): created successfully Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40de8242-c0d8-43f0-9670-b9bb44beaacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:44:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Flow 'volume_create_manager' (23a542f2-d371-4dcb-bb9b-192641d9af29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:44:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-671579e8-8cc5-40fb-b582-684720ff0799 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Created volume successfully. Jun 27 04:44:58 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:44:58 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:59 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa" returned: 0 in 0.833s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:59 devstack sudo[109619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa Jun 27 04:44:59 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:59 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.890s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:44:59 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebcbdbb-0905-4bd8-b8e3-3f47643d7ec8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:44:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:44:59 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:44:59 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:44:59 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root Jun 27 04:44:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa" released by "delete_volume" :: held 1.605s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Created reservations ['e40efda1-d44a-43b3-8f36-85c0197de67e', '748ef261-6f7e-4ddf-bcf3-6af6907871b0', 'be206ea3-8817-4740-ab5e-c8c8f51b4193', 'cb17b2f6-4151-4821-be07-c432938a399e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:00 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:00 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:00 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.887s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Acquiring lock "cinder-f8d750fb-2324-48ec-8387-e77ead919016-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:00 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img Jun 27 04:45:00 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "cinder-f8d750fb-2324-48ec-8387-e77ead919016-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-29ca3e30-7014-461f-94ee-f30263b6c3bd-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-29ca3e30-7014-461f-94ee-f30263b6c3bd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Acquiring lock "cinder-quobyte-f8d750fb-2324-48ec-8387-e77ead919016" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "cinder-quobyte-f8d750fb-2324-48ec-8387-e77ead919016" acquired by "delete_volume" :: waited 0.032s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-quobyte-29ca3e30-7014-461f-94ee-f30263b6c3bd" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788d94a-a50c-4f1c-9915-615589dd5962]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-29ca3e30-7014-461f-94ee-f30263b6c3bd" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c8d8b0-1201-4d10-ba5f-5183da62e24b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:00 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 Jun 27 04:45:00 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:00 devstack sudo[109635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd Jun 27 04:45:00 devstack sudo[109635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:01 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.897s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:01 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:01 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Deleted volume successfully. Jun 27 04:45:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ba4a44e1-37a0-42c2-a586-ceb806580288 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-d642efb1-cfa4-4ed9-a775-fd14b69ebeaa-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:02 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016" returned: 0 in 1.355s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:02 devstack sudo[109635]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd" returned: 0 in 1.351s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:02 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016 Jun 27 04:45:02 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:02 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd Jun 27 04:45:02 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:03 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-29ca3e30-7014-461f-94ee-f30263b6c3bd" returned: 0 in 1.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-29ca3e30-7014-461f-94ee-f30263b6c3bd" released by "delete_volume" :: held 3.258s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:04 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f8d750fb-2324-48ec-8387-e77ead919016" returned: 0 in 1.941s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "cinder-quobyte-f8d750fb-2324-48ec-8387-e77ead919016" released by "delete_volume" :: held 3.380s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Created reservations ['8218cd0d-9717-4fc5-a3a7-7c8780d02175', '76f27739-2351-4a34-8f05-a7ccf49d1df8', '73da4a22-3684-4bd3-bb39-382459c4265d', '4036129a-c244-4f91-9587-8b6f3dffc86e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Created reservations ['2d33af9a-0d7a-404f-902b-3c124e9d9501', '91c81661-9c05-4958-9160-951baaea90c5', '8ac38129-65e3-42ba-8c4d-0bf97e5a7406', '82260794-2f95-4485-b0a3-955f87e32e04'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:04 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:04 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:04 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:04 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:05 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:05 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-quobyte-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.527s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:05 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Deleted volume successfully. Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95" acquired by "delete_volume" :: waited 0.105s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eced5724-303d-4512-a750-7753a029bb22]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7796752-e23d-4c42-9cc1-7b658dc996b8 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-29ca3e30-7014-461f-94ee-f30263b6c3bd-delete_volume" released by "delete_volume" :: held 5.571s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:06 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 Jun 27 04:45:06 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:06 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.984s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Deleted volume successfully. Jun 27 04:45:06 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img" returned: 0 in 6.127s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dbf85e89-3391-4df2-bf74-6ddfa1c27e89 tempest-VolumeQuotasNegativeTestJSON-650358679 None] Lock "cinder-f8d750fb-2324-48ec-8387-e77ead919016-delete_volume" released by "delete_volume" :: held 6.070s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fbc1cd-affd-4512-a1b9-676af132818b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:06 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:45:06 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:07 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95" returned: 0 in 1.093s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:07 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95 Jun 27 04:45:07 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:07 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 1.087s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:45:07 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Converted 1024.00 MB image at 167.05 MB/s Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] 09ecd484-c5ba-4f31-b2f7-a7549f25ab01 was raw, converting to qcow2 {{(pid=93772) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe93dea-c9ee-4d7e-9455-d0881825967c]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:07 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img Jun 27 04:45:07 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:08 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95" returned: 0 in 0.839s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95" released by "delete_volume" :: held 2.036s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Created reservations ['b1ff2385-c11a-4b09-9698-cd0f69a09e51', 'bca02348-cba8-46f5-8aff-ded0f2f22679', '7ef32e2c-4b59-4b4e-823f-cceb585da0be', 'c802d9dd-fcab-4a4b-a2ff-e58f99a7c9f2'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:08 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:08 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:08 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img" returned: 0 in 0.880s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:08 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img Jun 27 04:45:08 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:09 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.890s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Deleted volume successfully. Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-e4e06944-fa46-4244-b07d-f1f285d30bc6-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-e4e06944-fa46-4244-b07d-f1f285d30bc6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f998f725-1479-4fd7-ad38-87b8c8844db2 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-c1d6a2b3-53b8-48f9-9bb0-d9a1df51ea95-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-quobyte-e4e06944-fa46-4244-b07d-f1f285d30bc6" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-e4e06944-fa46-4244-b07d-f1f285d30bc6" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[48540351-1fc9-41c3-9cf4-dd4f83a503b8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:09 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 Jun 27 04:45:09 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:09 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img" returned: 1 in 1.083s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:45:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img /opt/stack/data/cinder/conversion/vol_upload_cays4q6i {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:09 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img /opt/stack/data/cinder/conversion/vol_upload_cays4q6i Jun 27 04:45:09 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:10 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6" returned: 0 in 1.023s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:10 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6 Jun 27 04:45:10 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:10 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img /opt/stack/data/cinder/conversion/vol_upload_cays4q6i" returned: 0 in 0.891s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:10 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Image conversion details: src /opt/stack/data/cinder/conversion/d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54.temp_image.09ecd484-c5ba-4f31-b2f7-a7549f25ab013d1_8vv4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_cays4q6i {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:45:10 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 27 04:45:10 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a42453-8609-4f3b-ac21-f95c9460f41a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cays4q6i {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:10 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cays4q6i Jun 27 04:45:10 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:11 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e4e06944-fa46-4244-b07d-f1f285d30bc6" returned: 0 in 0.687s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-e4e06944-fa46-4244-b07d-f1f285d30bc6" released by "delete_volume" :: held 1.771s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Created reservations ['32ab9519-3585-46d0-99bd-8fae85576180', '51f648f2-bcb9-4f27-9350-20775c098ee8', '0358b01c-9f19-4501-a43e-a9a4a83a8e24', '562795f3-338f-474b-9797-c3b17d3579f6'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:11 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:11 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-0be7eb87-5e1a-4296-abb0-9903be6f36c3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-0be7eb87-5e1a-4296-abb0-9903be6f36c3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:11 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_cays4q6i" returned: 0 in 0.913s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "cinder-quobyte-0be7eb87-5e1a-4296-abb0-9903be6f36c3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-0be7eb87-5e1a-4296-abb0-9903be6f36c3" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c2d5a-a7f3-42d1-94dd-2861c167f36f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:11 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 Jun 27 04:45:11 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:12 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.767s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:12 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:12 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Deleted volume successfully. Jun 27 04:45:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1cfabe91-4b69-494f-a70a-580f9db616e9 tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-e4e06944-fa46-4244-b07d-f1f285d30bc6-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:12 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3" returned: 0 in 1.006s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:12 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3 Jun 27 04:45:12 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Flow 'volume_create_manager' (b6493d97-81b6-4991-a20a-68059d3c2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c6b1a4-68f6-4aa5-873e-43f6530dd0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c6b1a4-68f6-4aa5-873e-43f6530dd0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1304616979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8ca247-ceb8-47b1-853c-32b7de918ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df946f342d347d6a0aeecb752800923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:13Z,use_quota=True,user_id='7959b0e22d4a48a7b026cb27ca76e1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb0c620-cbfc-4279-a224-6644aa792ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb0c620-cbfc-4279-a224-6644aa792ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0279a0-40c2-4171-ad66-774faa8429dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0279a0-40c2-4171-ad66-774faa8429dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8ca247-ceb8-47b1-853c-32b7de918ba7', 'volume_name': 'volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0967754-479e-4029-a0e6-fe5c6c1364e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0967754-479e-4029-a0e6-fe5c6c1364e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356110c9-7b89-478b-a7b7-56638a301e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:13 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Volume cc8ca247-ceb8-47b1-853c-32b7de918ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7', 'volume_size': 1} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.774s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Uploaded volume to glance image-id: 09ecd484-c5ba-4f31-b2f7-a7549f25ab01. {{(pid=93772) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1304616979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8ca247-ceb8-47b1-853c-32b7de918ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df946f342d347d6a0aeecb752800923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:13Z,use_quota=True,user_id='7959b0e22d4a48a7b026cb27ca76e1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Creating volume cc8ca247-ceb8-47b1-853c-32b7de918ba7 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:13 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:13 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 1073741824 Jun 27 04:45:13 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:13 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-817dd71f-1695-4573-aa41-9e17cabe436b tempest-VolumesActionsTest-388163240 None] Copy volume to image completed successfully. Jun 27 04:45:13 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be7eb87-5e1a-4296-abb0-9903be6f36c3" returned: 0 in 0.805s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-quobyte-0be7eb87-5e1a-4296-abb0-9903be6f36c3" released by "delete_volume" :: held 1.864s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Created reservations ['4ff07d7e-10cb-430d-8fce-3e8b3b7d3373', 'd17f1273-a47d-4306-b0ba-6056b4432cb3', 'fc7909e8-e160-4281-ab88-9242c4aa793d', '49622a59-6ca5-4932-ba67-98ec3b376589'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:13 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:13 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:14 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 1073741824" returned: 0 in 1.287s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:14 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 Jun 27 04:45:14 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Acquiring lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:14 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.272s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:14 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:14 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Deleted volume successfully. Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Acquiring lock "cinder-quobyte-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-259bfb13-4a21-46a5-a957-b8382b0136fc tempest-CreateVolumesFromImageTest-690870217 None] Lock "cinder-0be7eb87-5e1a-4296-abb0-9903be6f36c3-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Lock "cinder-quobyte-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6608e86d-88b0-45cd-a2b9-ff22fd490eb6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:15 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:45:15 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:15 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7" returned: 0 in 0.898s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356110c9-7b89-478b-a7b7-56638a301e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6db3cc-394f-42f6-85db-b6d7e49f5941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:15 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Volume volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 (cc8ca247-ceb8-47b1-853c-32b7de918ba7): created successfully Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6db3cc-394f-42f6-85db-b6d7e49f5941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Flow 'volume_create_manager' (b6493d97-81b6-4991-a20a-68059d3c2234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-38d4e537-3eb0-46d3-b06b-ac4667af63ab tempest-VolumesServicesTestJSON-873014017 None] Created volume successfully. Jun 27 04:45:15 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:16 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54 Jun 27 04:45:16 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Acquiring lock "cinder-cc8ca247-ceb8-47b1-853c-32b7de918ba7-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Lock "cinder-cc8ca247-ceb8-47b1-853c-32b7de918ba7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Acquiring lock "cinder-quobyte-cc8ca247-ceb8-47b1-853c-32b7de918ba7" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Lock "cinder-quobyte-cc8ca247-ceb8-47b1-853c-32b7de918ba7" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:16 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" returned: 0 in 0.742s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Lock "cinder-quobyte-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54" released by "delete_volume" :: held 1.710s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4535d6e-c0ae-441e-9629-3c3fafeaef4a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Created reservations ['22c91b0f-3508-4108-b1df-e55ba1dbae5b', '1626ca01-a61d-4adb-a122-86278657d9ff', '3480b27a-333e-4891-8a30-99a6f490f941', 'e4fa4288-0a48-4bfc-bc3b-1aa212a31e8f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:16 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 Jun 27 04:45:16 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:16 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:16 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:17 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.736s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:17 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Deleted volume successfully. Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3a4380cd-56f6-4bf9-9a1b-09f0fc74add5 tempest-VolumesActionsTest-388163240 None] Lock "cinder-d1a1dcd4-d369-4d36-adc0-a75f4e8e8b54-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:17 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7" returned: 0 in 0.990s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:17 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7 Jun 27 04:45:17 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (78e71d53-18c4-4e32-bfb8-a06cf2a0a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57de7c0b-8c96-4a33-b131-6a99ad511cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57de7c0b-8c96-4a33-b131-6a99ad511cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558916026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363aa147-90c7-4b27-b285-a4c925cbce8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:18Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9674b082-4efa-48b8-ab48-91d78b04e7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9674b082-4efa-48b8-ab48-91d78b04e7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab32c2c-278a-4edb-9eed-80b6ef40ab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ab32c2c-278a-4edb-9eed-80b6ef40ab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '363aa147-90c7-4b27-b285-a4c925cbce8d', 'volume_name': 'volume-363aa147-90c7-4b27-b285-a4c925cbce8d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11db163-3199-480a-b837-53f684407332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11db163-3199-480a-b837-53f684407332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08315f0-e1af-484c-9120-57fdee3d9ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:17 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume 363aa147-90c7-4b27-b285-a4c925cbce8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-363aa147-90c7-4b27-b285-a4c925cbce8d', 'volume_size': 1} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-558916026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=363aa147-90c7-4b27-b285-a4c925cbce8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:18Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Creating volume 363aa147-90c7-4b27-b285-a4c925cbce8d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:17 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:17 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d 1073741824 Jun 27 04:45:17 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:18 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-cc8ca247-ceb8-47b1-853c-32b7de918ba7" returned: 0 in 0.758s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Lock "cinder-quobyte-cc8ca247-ceb8-47b1-853c-32b7de918ba7" released by "delete_volume" :: held 1.815s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Created reservations ['99bb8f6a-49e1-4856-9767-b448315d2ffe', '972917eb-9356-4d2c-9953-8c8939bf172b', '167ddaf2-64f5-4146-8f8a-25d1d99163ca', 'b30b70b0-b6c6-4345-adb4-ef54cf509458'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:18 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:18 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:19 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d 1073741824" returned: 0 in 1.177s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:19 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d Jun 27 04:45:19 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:19 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.807s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:19 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:19 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Deleted volume successfully. Jun 27 04:45:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c18424fe-1ccc-437b-9905-b2ae2538370a tempest-VolumesServicesTestJSON-873014017 None] Lock "cinder-cc8ca247-ceb8-47b1-853c-32b7de918ba7-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:20 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d" returned: 0 in 0.930s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08315f0-e1af-484c-9120-57fdee3d9ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-363aa147-90c7-4b27-b285-a4c925cbce8d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ac417e-d73d-48fc-962a-9c0a4d87cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:20 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume volume-363aa147-90c7-4b27-b285-a4c925cbce8d (363aa147-90c7-4b27-b285-a4c925cbce8d): created successfully Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ac417e-d73d-48fc-962a-9c0a4d87cb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (78e71d53-18c4-4e32-bfb8-a06cf2a0a25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:20 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1289a9a2-c4c0-460a-a2f1-7dad29f34d9c tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created volume successfully. Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:20 devstack sudo[109815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:20 devstack sudo[109815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:21 devstack sudo[109815]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (5e79610f-2872-457c-812e-b21fe3dd2304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6c4d28-217a-4744-8f84-829165752e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.133s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6c4d28-217a-4744-8f84-829165752e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390541910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebb1831-6284-4728-bf90-cf364a340eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:22Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe4fb7a-da23-4426-a2ee-c54ca0e1664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe4fb7a-da23-4426-a2ee-c54ca0e1664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d257bdb-576c-43d2-8c4b-f715ca27c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d257bdb-576c-43d2-8c4b-f715ca27c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebb1831-6284-4728-bf90-cf364a340eba', 'volume_name': 'volume-5ebb1831-6284-4728-bf90-cf364a340eba', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cbe61c-016b-4504-bcd1-155b71cb1d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7cbe61c-016b-4504-bcd1-155b71cb1d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc2373f-2184-4392-bf7a-8120f2687ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:21 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume 5ebb1831-6284-4728-bf90-cf364a340eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebb1831-6284-4728-bf90-cf364a340eba', 'volume_size': 1} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390541910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebb1831-6284-4728-bf90-cf364a340eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:22Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Creating volume 5ebb1831-6284-4728-bf90-cf364a340eba {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:21 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:21 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba 1073741824 Jun 27 04:45:21 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (2c397f7b-8fde-43a6-971a-6b5ff150aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4827f91a-a9d8-40d2-bac5-6c9770fac99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4827f91a-a9d8-40d2-bac5-6c9770fac99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906417261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7a6f25-9cd5-4414-8239-6ed5e073731d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:22Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e6bee8-421f-48c0-9757-7f511f5a3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e6bee8-421f-48c0-9757-7f511f5a3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791837b1-269e-4e84-b009-5464b27ca151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791837b1-269e-4e84-b009-5464b27ca151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7a6f25-9cd5-4414-8239-6ed5e073731d', 'volume_name': 'volume-da7a6f25-9cd5-4414-8239-6ed5e073731d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819ef70c-3e32-460a-8826-1e610c319e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819ef70c-3e32-460a-8826-1e610c319e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96ed37f-9cb4-49be-82b1-ea0b8beb116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume da7a6f25-9cd5-4414-8239-6ed5e073731d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7a6f25-9cd5-4414-8239-6ed5e073731d', 'volume_size': 1} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (ebaf1f2a-863b-4fc1-bbe6-64e4fcddeee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4724a6d2-cbf3-42a9-8ecd-db8f83b3dacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4724a6d2-cbf3-42a9-8ecd-db8f83b3dacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112292062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fbc3ee-b1e4-440f-a5ab-661bb8a6c688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:22Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b5fe84-5ce9-4f73-90bb-e574decd6018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b5fe84-5ce9-4f73-90bb-e574decd6018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865d96d9-9cbc-4284-96b0-3a266af17b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865d96d9-9cbc-4284-96b0-3a266af17b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fbc3ee-b1e4-440f-a5ab-661bb8a6c688', 'volume_name': 'volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5df46af-6738-4629-a577-a4ae11161a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5df46af-6738-4629-a577-a4ae11161a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb6623a-cd4d-4709-b494-8325adf7d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:22 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume 04fbc3ee-b1e4-440f-a5ab-661bb8a6c688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688', 'volume_size': 1} Jun 27 04:45:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (11ce4ff8-50c6-4f7b-a541-6a52b5428b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a795403-0bdb-4524-9d87-3eb2e5397e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a795403-0bdb-4524-9d87-3eb2e5397e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1778151647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73b1340-a0db-4e1c-bea3-626b0c7f74cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:23Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a6e0e5-3ece-4cbe-8f71-07f7c491d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a6e0e5-3ece-4cbe-8f71-07f7c491d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01010dc9-909a-465e-b3f1-40f52a276994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01010dc9-909a-465e-b3f1-40f52a276994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73b1340-a0db-4e1c-bea3-626b0c7f74cf', 'volume_name': 'volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd9b394-95f6-464f-9e88-ad8d2d8279ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd9b394-95f6-464f-9e88-ad8d2d8279ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b487ce-d210-4cbf-9dcf-8248608bba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume e73b1340-a0db-4e1c-bea3-626b0c7f74cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf', 'volume_size': 1} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba 1073741824" returned: 0 in 1.493s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:23 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba Jun 27 04:45:23 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (af4ebc1a-195c-4f86-9891-401d5d0c7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90336429-ea7f-43c4-a29d-91946f574f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90336429-ea7f-43c4-a29d-91946f574f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664568107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ee98de-6e78-4903-a71f-237c38b749b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:24Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf05d2c9-01dc-4b23-9b87-3bcd5077a24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf05d2c9-01dc-4b23-9b87-3bcd5077a24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf481e0-b42a-4d9a-8ae2-a86d9b4f1fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf481e0-b42a-4d9a-8ae2-a86d9b4f1fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ee98de-6e78-4903-a71f-237c38b749b5', 'volume_name': 'volume-c0ee98de-6e78-4903-a71f-237c38b749b5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e0d7fd-6af4-41e7-a93f-3559436c3235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e0d7fd-6af4-41e7-a93f-3559436c3235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cf16aa-f10b-4b34-a206-020bda561c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:23 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume c0ee98de-6e78-4903-a71f-237c38b749b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ee98de-6e78-4903-a71f-237c38b749b5', 'volume_size': 1} Jun 27 04:45:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:24 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba" returned: 0 in 0.939s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] <== create_volume: return (2511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906417261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7a6f25-9cd5-4414-8239-6ed5e073731d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:22Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Creating volume da7a6f25-9cd5-4414-8239-6ed5e073731d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:24 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:24 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d 1073741824 Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc2373f-2184-4392-bf7a-8120f2687ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebb1831-6284-4728-bf90-cf364a340eba', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:24 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8278de2-0547-4187-8189-a0ebb91b53e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:24 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume volume-5ebb1831-6284-4728-bf90-cf364a340eba (5ebb1831-6284-4728-bf90-cf364a340eba): created successfully Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8278de2-0547-4187-8189-a0ebb91b53e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (5e79610f-2872-457c-812e-b21fe3dd2304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f4f374f8-4946-46c4-947f-6a94facb44ff tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created volume successfully. Jun 27 04:45:25 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d 1073741824" returned: 0 in 0.976s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:25 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d Jun 27 04:45:25 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Flow 'volume_create_manager' (34574d12-e63d-4669-99a6-4f2f97ec7a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9bfc7c0-f43f-4ba1-b475-e2769a8f62f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9bfc7c0-f43f-4ba1-b475-e2769a8f62f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-700344964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759a6672-0020-4ba4-83fd-14253cfbd71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac487406f06f493881edcb6da0448cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:26Z,use_quota=True,user_id='bc2b646a666440cca1e7cfc0d776964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a4531c-dc97-400d-8727-401c781ecea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a4531c-dc97-400d-8727-401c781ecea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2fb235-4ed4-4a02-8d29-e3f30d5cfc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2fb235-4ed4-4a02-8d29-e3f30d5cfc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759a6672-0020-4ba4-83fd-14253cfbd71b', 'volume_name': 'volume-759a6672-0020-4ba4-83fd-14253cfbd71b', 'volume_size': 2}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56186771-d190-4d01-a496-293920e07ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56186771-d190-4d01-a496-293920e07ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2709498-4021-45d1-baff-0bf45aebc72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:25 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Volume 759a6672-0020-4ba4-83fd-14253cfbd71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759a6672-0020-4ba4-83fd-14253cfbd71b', 'volume_size': 2} Jun 27 04:45:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:26 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d" returned: 0 in 0.730s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-112292062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fbc3ee-b1e4-440f-a5ab-661bb8a6c688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:22Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Creating volume 04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:26 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:26 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 1073741824 Jun 27 04:45:26 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96ed37f-9cb4-49be-82b1-ea0b8beb116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7a6f25-9cd5-4414-8239-6ed5e073731d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fdcad6-199a-4f93-a096-483ffd436a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:26 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume volume-da7a6f25-9cd5-4414-8239-6ed5e073731d (da7a6f25-9cd5-4414-8239-6ed5e073731d): created successfully Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fdcad6-199a-4f93-a096-483ffd436a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (2c397f7b-8fde-43a6-971a-6b5ff150aaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:26 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-526d7f47-929c-4e78-91ed-0fe4f7f0cfc8 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created volume successfully. Jun 27 04:45:26 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Flow 'volume_create_manager' (586bbafc-38ca-48a7-8d02-6b6b3faa02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7b44c3-b7b6-4bd4-a479-7460e2836cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7b44c3-b7b6-4bd4-a479-7460e2836cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-193526023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a596405b-b396-49b5-b598-9f44ef16da2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9293141e6cc047da977d585f01f86a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:27Z,use_quota=True,user_id='fb37dbca331345a781d6062e41fa7e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04583778-6ce9-415e-add7-3deaf47c955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04583778-6ce9-415e-add7-3deaf47c955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099e7a59-91a0-4e49-a986-05dedcbfec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099e7a59-91a0-4e49-a986-05dedcbfec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a596405b-b396-49b5-b598-9f44ef16da2e', 'volume_name': 'volume-a596405b-b396-49b5-b598-9f44ef16da2e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af7f257-7184-4421-93d7-be9304274880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af7f257-7184-4421-93d7-be9304274880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8f9088-3ebd-42ac-b0d8-418967d87d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:27 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Volume a596405b-b396-49b5-b598-9f44ef16da2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a596405b-b396-49b5-b598-9f44ef16da2e', 'volume_size': 1} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:27 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 1073741824" returned: 0 in 0.948s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:27 devstack sudo[109844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 Jun 27 04:45:27 devstack sudo[109844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:27 devstack sudo[109844]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688" returned: 0 in 0.629s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.410s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1778151647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73b1340-a0db-4e1c-bea3-626b0c7f74cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:23Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Creating volume e73b1340-a0db-4e1c-bea3-626b0c7f74cf {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:27 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:27 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf 1073741824 Jun 27 04:45:27 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb6623a-cd4d-4709-b494-8325adf7d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380e891f-b1ac-4fc7-9f76-2ed532fbe21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:27 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 (04fbc3ee-b1e4-440f-a5ab-661bb8a6c688): created successfully Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380e891f-b1ac-4fc7-9f76-2ed532fbe21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (ebaf1f2a-863b-4fc1-bbe6-64e4fcddeee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5928539c-d99d-406a-914e-d9804fae02fc tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created volume successfully. Jun 27 04:45:28 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf 1073741824" returned: 0 in 0.869s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:28 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf Jun 27 04:45:28 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:29 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf" returned: 0 in 0.636s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.493s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-664568107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ee98de-6e78-4903-a71f-237c38b749b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ea04d398724b04af8940dbb696b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:24Z,use_quota=True,user_id='a346f04b59124386a6c565bdc26d1faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Creating volume c0ee98de-6e78-4903-a71f-237c38b749b5 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:29 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b487ce-d210-4cbf-9dcf-8248608bba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:29 devstack sudo[109856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 1073741824 Jun 27 04:45:29 devstack sudo[109856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc3b908-8959-4c27-9359-d4185efb1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf (e73b1340-a0db-4e1c-bea3-626b0c7f74cf): created successfully Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc3b908-8959-4c27-9359-d4185efb1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (11ce4ff8-50c6-4f7b-a541-6a52b5428b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8a2a996f-19f7-43eb-b0d8-77a3176ebeda tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created volume successfully. Jun 27 04:45:30 devstack sudo[109856]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 1073741824" returned: 0 in 0.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:30 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 Jun 27 04:45:30 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:30 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5" returned: 0 in 0.670s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.156s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-700344964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759a6672-0020-4ba4-83fd-14253cfbd71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac487406f06f493881edcb6da0448cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:26Z,use_quota=True,user_id='bc2b646a666440cca1e7cfc0d776964f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Creating volume 759a6672-0020-4ba4-83fd-14253cfbd71b {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:30 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b 2147483648 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:31 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b 2147483648 Jun 27 04:45:31 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82cf16aa-f10b-4b34-a206-020bda561c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ee98de-6e78-4903-a71f-237c38b749b5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3365ce8-6a73-46ca-b7cc-7a8cd8fe2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:31 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Volume volume-c0ee98de-6e78-4903-a71f-237c38b749b5 (c0ee98de-6e78-4903-a71f-237c38b749b5): created successfully Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3365ce8-6a73-46ca-b7cc-7a8cd8fe2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Flow 'volume_create_manager' (af4ebc1a-195c-4f86-9891-401d5d0c7a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2814d68e-bb21-4c21-8292-90041bc18efe tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created volume successfully. Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-c0ee98de-6e78-4903-a71f-237c38b749b5-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-c0ee98de-6e78-4903-a71f-237c38b749b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-quobyte-c0ee98de-6e78-4903-a71f-237c38b749b5" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-c0ee98de-6e78-4903-a71f-237c38b749b5" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872dbbb-2370-416c-bbd0-52c9974a2a5b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:31 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 Jun 27 04:45:31 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:31 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b 2147483648" returned: 0 in 0.900s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:31 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b Jun 27 04:45:31 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:32 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5" returned: 0 in 0.873s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:32 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5 Jun 27 04:45:32 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:32 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b" returned: 0 in 0.717s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.572s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-193526023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a596405b-b396-49b5-b598-9f44ef16da2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9293141e6cc047da977d585f01f86a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:27Z,use_quota=True,user_id='fb37dbca331345a781d6062e41fa7e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Creating volume a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:32 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:32 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e 1073741824 Jun 27 04:45:32 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2709498-4021-45d1-baff-0bf45aebc72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759a6672-0020-4ba4-83fd-14253cfbd71b', 'volume_size': 2}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9aafbe9-40a7-4276-95de-7b9a0ca29883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Volume volume-759a6672-0020-4ba4-83fd-14253cfbd71b (759a6672-0020-4ba4-83fd-14253cfbd71b): created successfully Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9aafbe9-40a7-4276-95de-7b9a0ca29883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Flow 'volume_create_manager' (34574d12-e63d-4669-99a6-4f2f97ec7a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0c599cac-ad62-4b32-8e2e-96f098b0e91e tempest-VolumesCloneNegativeTest-257805831 None] Created volume successfully. Jun 27 04:45:33 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c0ee98de-6e78-4903-a71f-237c38b749b5" returned: 0 in 0.719s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-c0ee98de-6e78-4903-a71f-237c38b749b5" released by "delete_volume" :: held 1.643s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created reservations ['ccab06f1-28d7-4644-b6c8-c3dc9ccadcca', '822cc152-7201-48b4-86ab-d8e8a10f5289', '914a92b8-ead3-4715-9b63-34abea5ffeaf', '9d856641-f842-4395-a538-3ea7bc588ec7'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Acquiring lock "cinder-759a6672-0020-4ba4-83fd-14253cfbd71b-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Lock "cinder-759a6672-0020-4ba4-83fd-14253cfbd71b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Acquiring lock "cinder-quobyte-759a6672-0020-4ba4-83fd-14253cfbd71b" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:33 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:33 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Lock "cinder-quobyte-759a6672-0020-4ba4-83fd-14253cfbd71b" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b476d1d9-4f9f-4568-b368-770199e49787]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:33 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b Jun 27 04:45:33 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:33 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e 1073741824" returned: 0 in 0.961s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:33 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e Jun 27 04:45:33 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-e73b1340-a0db-4e1c-bea3-626b0c7f74cf-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-e73b1340-a0db-4e1c-bea3-626b0c7f74cf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-quobyte-e73b1340-a0db-4e1c-bea3-626b0c7f74cf" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-e73b1340-a0db-4e1c-bea3-626b0c7f74cf" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d28db1-d9a0-4d2a-80b9-0708c8551c27]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:34 devstack sudo[109897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf Jun 27 04:45:34 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:34 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.869s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Deleted volume successfully. Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cb5ca0e0-8856-4b4a-a503-c9334f530e98 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-c0ee98de-6e78-4903-a71f-237c38b749b5-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:34 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e" returned: 0 in 0.792s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:34 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8f9088-3ebd-42ac-b0d8-418967d87d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a596405b-b396-49b5-b598-9f44ef16da2e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24a1aeb-e25b-4349-8145-70ad568ba7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b" returned: 0 in 1.061s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:34 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Volume volume-a596405b-b396-49b5-b598-9f44ef16da2e (a596405b-b396-49b5-b598-9f44ef16da2e): created successfully Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b24a1aeb-e25b-4349-8145-70ad568ba7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:34 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b Jun 27 04:45:34 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Flow 'volume_create_manager' (586bbafc-38ca-48a7-8d02-6b6b3faa02f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d9b445f3-6144-443a-8007-d38f37fdd56f tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Created volume successfully. Jun 27 04:45:34 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf" returned: 0 in 0.839s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:34 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf Jun 27 04:45:34 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:35 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-759a6672-0020-4ba4-83fd-14253cfbd71b" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Lock "cinder-quobyte-759a6672-0020-4ba4-83fd-14253cfbd71b" released by "delete_volume" :: held 1.833s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Created reservations ['8d429d34-5fe5-4dcb-b981-3982da1c47a3', '59d211ac-de15-420d-b7fa-2684b37cbb41', 'a179e568-8c52-4b7c-b0bd-8c3126da07f9', 'd65aa2a3-7962-4f9b-a529-f072a94529c6'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:35 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:35 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:35 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e73b1340-a0db-4e1c-bea3-626b0c7f74cf" returned: 0 in 0.709s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-e73b1340-a0db-4e1c-bea3-626b0c7f74cf" released by "delete_volume" :: held 1.637s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created reservations ['ebada51d-4bca-45b7-afc7-26c62a86e8a1', '3fc8f775-5871-4cab-9529-6397de9db89c', '5b48e29c-457b-491e-837b-0551b10963ba', 'd319f828-2855-4428-9d35-3d21cae97b5f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:35 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:35 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Creating offline snapshot bb01f50f-6188-44a1-a1f4-82a6580b5ba9 of volume a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a296e5e-0dfb-4b08-84d4-a93c94b55d20]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:35 devstack sudo[109917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e Jun 27 04:45:35 devstack sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:36 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.879s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-quobyte-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Deleted volume successfully. Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-949c95bd-c99a-4c3f-88cc-fcf7a8942e8d tempest-VolumesCloneNegativeTest-257805831 None] Lock "cinder-759a6672-0020-4ba4-83fd-14253cfbd71b-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688" acquired by "delete_volume" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa83b1-d78f-4f2a-827d-0ce55266b531]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:36 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 Jun 27 04:45:36 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:36 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.921s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Deleted volume successfully. Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-76591c14-177d-4b0f-9f71-c934ae0e7a04 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-e73b1340-a0db-4e1c-bea3-626b0c7f74cf-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:36 devstack sudo[109917]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e" returned: 0 in 0.982s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:36 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 1G Jun 27 04:45:36 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:37 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688" returned: 0 in 0.958s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:37 devstack sudo[109931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688 Jun 27 04:45:37 devstack sudo[109931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:37 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 1G" returned: 0 in 0.921s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a596405b-b396-49b5-b598-9f44ef16da2e -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:37 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a596405b-b396-49b5-b598-9f44ef16da2e -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 Jun 27 04:45:37 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:37 devstack sudo[109931]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688" returned: 0 in 0.701s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688" released by "delete_volume" :: held 1.731s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created reservations ['bb9c9087-151d-446a-a472-0bca55625908', '93873080-781e-469e-8cad-e35d6989976e', '45141997-8974-4227-8117-16a86f2ae998', '766c7ffa-510e-4450-9ade-0a7a96da7ec8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:38 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:38 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-da7a6f25-9cd5-4414-8239-6ed5e073731d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-da7a6f25-9cd5-4414-8239-6ed5e073731d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-quobyte-da7a6f25-9cd5-4414-8239-6ed5e073731d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-da7a6f25-9cd5-4414-8239-6ed5e073731d" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:38 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a596405b-b396-49b5-b598-9f44ef16da2e -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9" returned: 0 in 0.922s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:38 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 is being set with open permissions: ugo+rw Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9124bd64-0b95-44f4-9fa3-e939c2b41c4f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:38 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 Jun 27 04:45:38 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:38 devstack sudo[109945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d Jun 27 04:45:38 devstack sudo[109945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:38 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.780s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Deleted volume successfully. Jun 27 04:45:38 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-69750c84-25ea-4f5c-ae95-d79876567182 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-04fbc3ee-b1e4-440f-a5ab-661bb8a6c688-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:39 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9" returned: 0 in 0.757s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:39 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info Jun 27 04:45:39 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Flow 'volume_create_manager' (27cae7dc-5ec9-43c6-b7ab-e1cd101a0da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:39 devstack sudo[109945]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a19b1c-f116-4da6-80d2-693e314c5f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d" returned: 0 in 0.950s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a19b1c-f116-4da6-80d2-693e314c5f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-902136048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513b53a0-e5b5-4ad9-91a3-8a2412c5b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9251f0e1a8142b285cdf863c4b9df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:40Z,use_quota=True,user_id='143b663f3eb1426e8a632801bdcf7238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a968382-e28c-4af3-9a97-2b0dbdfaa41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:39 devstack sudo[109955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a968382-e28c-4af3-9a97-2b0dbdfaa41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:39 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54616345-a367-4b9a-8964-cdfccd878714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54616345-a367-4b9a-8964-cdfccd878714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '513b53a0-e5b5-4ad9-91a3-8a2412c5b107', 'volume_name': 'volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd95d343-62d5-4c0a-8150-16338f93dcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd95d343-62d5-4c0a-8150-16338f93dcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0fbd4c-9559-419f-8a17-42a4b9418b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:39 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Volume 513b53a0-e5b5-4ad9-91a3-8a2412c5b107: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 04:45:39 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Trying to clone 513b53a0-e5b5-4ad9-91a3-8a2412c5b107 from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:45:40 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info" returned: 0 in 0.734s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:40 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info is being set with open permissions: ugo+rw Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:40 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info Jun 27 04:45:40 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:45:40 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Image download 20.69 MB at 20.69 MB/s Jun 27 04:45:40 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-da7a6f25-9cd5-4414-8239-6ed5e073731d" returned: 0 in 0.752s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-da7a6f25-9cd5-4414-8239-6ed5e073731d" released by "delete_volume" :: held 1.773s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c95f52-bb5e-4526-879f-8f29fd65b5ad]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created reservations ['c519d10f-a652-4fe6-a6dd-7c77fd524216', '0953ffa7-c60d-4d40-9899-a6b2e2ef45d7', '7220d066-1d0d-4365-96c2-8f46c9910414', '1f749f36-09fd-4e1b-9f4d-af6d3861af1a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:40 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD Jun 27 04:45:40 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:40 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:40 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-5ebb1831-6284-4728-bf90-cf364a340eba-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-5ebb1831-6284-4728-bf90-cf364a340eba-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-quobyte-5ebb1831-6284-4728-bf90-cf364a340eba" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:40 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.info" returned: 0 in 0.731s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.182s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:40 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-5ebb1831-6284-4728-bf90-cf364a340eba" acquired by "delete_volume" :: waited 0.056s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c53debf-6a50-4070-bb8e-8796328305c6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ccebe3f6-ef49-4e1c-a0fd-ed25e7378c4c tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Create snapshot completed successfully Jun 27 04:45:41 devstack sudo[109967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba Jun 27 04:45:41 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:41 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD" returned: 0 in 0.898s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 is fetched for user 143b663f3eb1426e8a632801bdcf7238. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:45:41 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.777s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Deleted volume successfully. Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bdbf2947-04af-440f-81e5-64d65e202c3e tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-da7a6f25-9cd5-4414-8239-6ed5e073731d-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f89ed5-f2ac-4c61-9fa5-21c8a5ff6d27]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:41 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD Jun 27 04:45:41 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:41 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba" returned: 0 in 0.871s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:41 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba Jun 27 04:45:41 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:42 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD" returned: 0 in 0.783s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-902136048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513b53a0-e5b5-4ad9-91a3-8a2412c5b107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9251f0e1a8142b285cdf863c4b9df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:40Z,use_quota=True,user_id='143b663f3eb1426e8a632801bdcf7238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Creating volume 513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:42 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:42 devstack sudo[109985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 1073741824 Jun 27 04:45:42 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:42 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5ebb1831-6284-4728-bf90-cf364a340eba" returned: 0 in 0.705s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "cinder-bb01f50f-6188-44a1-a1f4-82a6580b5ba9-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-5ebb1831-6284-4728-bf90-cf364a340eba" released by "delete_volume" :: held 1.639s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-bb01f50f-6188-44a1-a1f4-82a6580b5ba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "cinder-quobyte-a596405b-b396-49b5-b598-9f44ef16da2e" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-quobyte-a596405b-b396-49b5-b598-9f44ef16da2e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "cinder-quobyte-bb01f50f-6188-44a1-a1f4-82a6580b5ba9" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-quobyte-bb01f50f-6188-44a1-a1f4-82a6580b5ba9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Deleting offline snapshot bb01f50f-6188-44a1-a1f4-82a6580b5ba9 of volume a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] snapshot_file for this snap is: volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created reservations ['001331c3-152a-4e82-8e75-3227aa4b7967', 'a04663da-07b2-42ac-b466-6650ee46e1c6', 'a11c2234-ee5c-4ef0-b386-0dbb8e1b3cee', '0ddda929-8b34-4348-9627-035837c897bf'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb485371-9cd4-4bf4-ae92-db13ab54fb13]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:42 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 Jun 27 04:45:42 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:42 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:42 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-363aa147-90c7-4b27-b285-a4c925cbce8d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-363aa147-90c7-4b27-b285-a4c925cbce8d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "cinder-quobyte-363aa147-90c7-4b27-b285-a4c925cbce8d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-363aa147-90c7-4b27-b285-a4c925cbce8d" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb5e0cd-279a-4874-97ca-ccc8665833f6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:43 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 1073741824" returned: 0 in 1.068s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:43 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:43 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:43 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d Jun 27 04:45:43 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:43 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9" returned: 0 in 0.892s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a596405b-b396-49b5-b598-9f44ef16da2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6ca62-d96f-4219-909f-88763f6c4c24]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:43 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.850s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:43 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Deleted volume successfully. Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=164,cinder:SELECT=99,cinder:DELETE=17,cinder:INSERT=31 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:45:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b59e0355-d6aa-4f3c-ad67-2d7c0348a2ad tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-5ebb1831-6284-4728-bf90-cf364a340eba-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:43 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e Jun 27 04:45:43 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:44 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 0 in 0.714s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=109,cinder:INSERT=43,cinder:UPDATE=154,cinder:DELETE=13 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Attempting download of 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume 513b53a0-e5b5-4ad9-91a3-8a2412c5b107. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc59d8-9131-44e0-87d5-50751e854c4a]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:44 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d" returned: 0 in 0.975s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:44 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n Jun 27 04:45:44 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:44 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d Jun 27 04:45:44 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:44 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e" returned: 0 in 0.869s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:44 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 Jun 27 04:45:44 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:44 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-363aa147-90c7-4b27-b285-a4c925cbce8d" returned: 0 in 0.679s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-quobyte-363aa147-90c7-4b27-b285-a4c925cbce8d" released by "delete_volume" :: held 1.712s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:44 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n" returned: 0 in 0.818s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Created reservations ['4b7d793b-3911-4751-a03a-8d3476b5f435', '69cbeecc-25ed-44b6-ad07-597e4b98a41a', '850a9bea-34c4-4d90-8d95-19f752740835', '66f8be4a-108c-4085-9ee6-c5d96ec26848'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:45 devstack sudo[110023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n Jun 27 04:45:45 devstack sudo[110023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:45 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:45 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:45 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9" returned: 0 in 0.828s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:45 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9 Jun 27 04:45:45 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:45 devstack sudo[110023]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n" returned: 1 in 0.859s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_vlsged8n' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:45:45 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f704e0fb-2efe-4a62-8aa8-81b8002ee43e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.750s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:45 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Deleted volume successfully. Jun 27 04:45:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-86c26ed9-70ea-4d5e-8792-94374e5f79e2 tempest-CreateVolumesFromSourceVolumeTest-621518993 None] Lock "cinder-363aa147-90c7-4b27-b285-a4c925cbce8d-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:45 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD Jun 27 04:45:45 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:46 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e.bb01f50f-6188-44a1-a1f4-82a6580b5ba9" returned: 0 in 0.775s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-quobyte-bb01f50f-6188-44a1-a1f4-82a6580b5ba9" released by "_delete_snapshot" :: held 3.546s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-quobyte-a596405b-b396-49b5-b598-9f44ef16da2e" released by "delete_snapshot" :: held 3.582s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Created reservations ['75ba0fa3-7cfc-4c5a-83a9-83be7d614bf2', '794b5bfb-a8c8-4b3e-8d91-1fdee802bf58', '04810957-b017-418c-bf91-fb92947a33be', 'bfbcfb8e-07d3-47e0-8b4e-350df7629ff9'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:46 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Delete snapshot completed successfully. Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3e9c0efd-e42d-43a3-8957-6c87490687f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-bb01f50f-6188-44a1-a1f4-82a6580b5ba9-delete_snapshot" released by "delete_snapshot" :: held 3.743s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:46 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD" returned: 0 in 0.838s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] 65172e40-e60b-42ac-beb4-f7bdf5b877f2 was qcow2, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:45:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:46 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:46 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "cinder-a596405b-b396-49b5-b598-9f44ef16da2e-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-a596405b-b396-49b5-b598-9f44ef16da2e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "cinder-quobyte-a596405b-b396-49b5-b598-9f44ef16da2e" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-quobyte-a596405b-b396-49b5-b598-9f44ef16da2e" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c227ea9-2365-457c-9933-93e28d08ee6e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:47 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e Jun 27 04:45:47 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:47 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e" returned: 0 in 0.778s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:47 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e Jun 27 04:45:47 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:48 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 0 in 1.959s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_n1cam797devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:45:48 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Converted 112.00 MB image at 57.13 MB/s Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:48 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 1G Jun 27 04:45:48 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:48 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a596405b-b396-49b5-b598-9f44ef16da2e" returned: 0 in 0.692s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-quobyte-a596405b-b396-49b5-b598-9f44ef16da2e" released by "delete_volume" :: held 1.530s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Created reservations ['97cd1fca-2da9-4bb0-bd09-76e337b24d71', 'c2d51483-1bf7-4202-b424-0557a6f4b13a', 'c68eeb75-bb9b-49c9-8b70-5d1499c274c9', 'bdc185fc-8ec4-4a5c-a22a-4ed534bea7d8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:48 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:48 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:49 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 1G" returned: 0 in 0.733s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a06c334-152f-4854-af06-1f47a551c50a]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:49 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.667s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:49 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Deleted volume successfully. Jun 27 04:45:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d1e323aa-5263-4575-aaeb-702b3e8308b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1673018454 None] Lock "cinder-a596405b-b396-49b5-b598-9f44ef16da2e-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:49 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:49 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:50 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 0 in 0.780s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:50 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:50 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:51 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 1 in 0.810s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Downloaded image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume 513b53a0-e5b5-4ad9-91a3-8a2412c5b107 successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 for user 143b663f3eb1426e8a632801bdcf7238 is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Marking volume 513b53a0-e5b5-4ad9-91a3-8a2412c5b107 as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Copying metadata from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 to 513b53a0-e5b5-4ad9-91a3-8a2412c5b107. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Creating volume glance metadata for volume 513b53a0-e5b5-4ad9-91a3-8a2412c5b107 backed by image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0fbd4c-9559-419f-8a17-42a4b9418b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6896e5-c2eb-486c-be28-fb68749f4500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:51 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Volume volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 (513b53a0-e5b5-4ad9-91a3-8a2412c5b107): created successfully Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6896e5-c2eb-486c-be28-fb68749f4500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Flow 'volume_create_manager' (27cae7dc-5ec9-43c6-b7ab-e1cd101a0da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cf45d952-9fa7-4cf2-8dac-816a7b0c8efd tempest-VolumesExtendTest-763584526 None] Created volume successfully. Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517d0f3-f62f-40cd-a128-e68cdd0297a4]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:51 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:51 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:52 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 0 in 0.809s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:52 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:52 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:53 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 1 in 0.756s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 2G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 2G" returned: 0 in 0.064s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.680s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e6f97137-54e8-434e-8c7c-51e321493105 tempest-VolumesExtendTest-763584526 None] Extend volume completed successfully. Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-513b53a0-e5b5-4ad9-91a3-8a2412c5b107-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Lock "cinder-513b53a0-e5b5-4ad9-91a3-8a2412c5b107-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-quobyte-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:45:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:45:54 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65cedf7-a0d5-4db3-b0ee-1c966e0bc8bd]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:45:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:54 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:54 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:54 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 0 in 0.791s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:54 devstack sudo[110091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:54 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:55 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 1 in 0.760s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:45:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:55 devstack sudo[110096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107 Jun 27 04:45:55 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:56 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" returned: 0 in 0.685s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-513b53a0-e5b5-4ad9-91a3-8a2412c5b107" released by "delete_volume" :: held 2.304s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Created reservations ['c5335bcd-f852-4fb1-a9bb-2e578d924b5c', '14dd4731-953b-46b1-afb6-1efbbc55834e', '0ea09a74-6e2e-4161-b1e1-577431dfe425', '7fa53324-0f51-4eeb-a533-fc27471948e0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:56 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:45:56 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:57 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.734s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:45:57 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Deleted volume successfully. Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bbe47717-eb70-497e-bc5c-522ab947616a tempest-VolumesExtendTest-763584526 None] Lock "cinder-513b53a0-e5b5-4ad9-91a3-8a2412c5b107-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Flow 'volume_create_manager' (42f44fde-191c-457e-8059-b44fb5e52923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5814df40-3f4a-4edf-a930-0332e7370fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5814df40-3f4a-4edf-a930-0332e7370fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-376907535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34611124-b2ba-4e44-acf9-4b87619b7212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9251f0e1a8142b285cdf863c4b9df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:58Z,use_quota=True,user_id='143b663f3eb1426e8a632801bdcf7238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30dc0f7-9b65-45cc-84b1-335e307a134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30dc0f7-9b65-45cc-84b1-335e307a134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f2c837-6808-41a6-85e3-1fe0afaafdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f2c837-6808-41a6-85e3-1fe0afaafdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34611124-b2ba-4e44-acf9-4b87619b7212', 'volume_name': 'volume-34611124-b2ba-4e44-acf9-4b87619b7212', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff702f79-df48-486f-b206-bc30dff2853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff702f79-df48-486f-b206-bc30dff2853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a69b838-9ea7-437d-9fc4-fdbda85ddc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:57 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Volume 34611124-b2ba-4e44-acf9-4b87619b7212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34611124-b2ba-4e44-acf9-4b87619b7212', 'volume_size': 1} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-376907535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34611124-b2ba-4e44-acf9-4b87619b7212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9251f0e1a8142b285cdf863c4b9df0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:45:58Z,use_quota=True,user_id='143b663f3eb1426e8a632801bdcf7238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Creating volume 34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:45:57 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:45:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:57 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 1073741824 Jun 27 04:45:57 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:58 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 1073741824" returned: 0 in 0.897s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:45:58 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 Jun 27 04:45:58 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:45:59 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212" returned: 0 in 0.683s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a69b838-9ea7-437d-9fc4-fdbda85ddc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34611124-b2ba-4e44-acf9-4b87619b7212', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5996dd-c21b-46a6-922f-25c93d338ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:45:59 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Volume volume-34611124-b2ba-4e44-acf9-4b87619b7212 (34611124-b2ba-4e44-acf9-4b87619b7212): created successfully Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f5996dd-c21b-46a6-922f-25c93d338ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:45:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Flow 'volume_create_manager' (42f44fde-191c-457e-8059-b44fb5e52923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:45:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cb925364-2eac-4b49-9e9c-1b8be7dd30cb tempest-VolumesExtendTest-763584526 None] Created volume successfully. Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Creating offline snapshot 0d33e536-60f6-4706-992d-255479c2c59b of volume 34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[705775c2-5882-4290-b30e-70e5b547487e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:00 devstack sudo[110112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 Jun 27 04:46:00 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:00 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212" returned: 0 in 0.840s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:01 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b 1G Jun 27 04:46:01 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:01 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b 1G" returned: 0 in 0.894s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34611124-b2ba-4e44-acf9-4b87619b7212 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:01 devstack sudo[110126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34611124-b2ba-4e44-acf9-4b87619b7212 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b Jun 27 04:46:01 devstack sudo[110126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:02 devstack sudo[110126]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34611124-b2ba-4e44-acf9-4b87619b7212 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b" returned: 0 in 0.755s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:02 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b is being set with open permissions: ugo+rw Jun 27 04:46:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:02 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b Jun 27 04:46:02 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:03 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b" returned: 0 in 0.653s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:03 devstack sudo[110134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info Jun 27 04:46:03 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:04 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info" returned: 0 in 0.736s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:04 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info is being set with open permissions: ugo+rw Jun 27 04:46:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:04 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info Jun 27 04:46:04 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:04 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.info" returned: 0 in 0.622s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.599s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:04 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4966a383-ae2f-4a82-8402-2fac9fe0cc74 tempest-VolumesExtendTest-763584526 None] Create snapshot completed successfully Jun 27 04:46:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:05 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81dc31b-0fcc-443d-92ef-e57af9b74298]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:05 devstack sudo[110140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 Jun 27 04:46:05 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:06 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212" returned: 0 in 0.829s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b 2G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b 2G" returned: 0 in 0.137s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-778f6874-67db-49e5-b110-3e7a94a3d176 tempest-VolumesExtendTest-763584526 None] Extend volume completed successfully. Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-0d33e536-60f6-4706-992d-255479c2c59b-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Lock "cinder-0d33e536-60f6-4706-992d-255479c2c59b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-quobyte-34611124-b2ba-4e44-acf9-4b87619b7212" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-34611124-b2ba-4e44-acf9-4b87619b7212" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-quobyte-0d33e536-60f6-4706-992d-255479c2c59b" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-0d33e536-60f6-4706-992d-255479c2c59b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Deleting offline snapshot 0d33e536-60f6-4706-992d-255479c2c59b of volume 34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] snapshot_file for this snap is: volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb58c7d-7d38-46d3-8445-33e008e4a3eb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:06 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b Jun 27 04:46:06 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:07 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b" returned: 0 in 0.840s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34611124-b2ba-4e44-acf9-4b87619b7212(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ecf432-8491-4d1c-8997-21d649abc2a0]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:07 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 Jun 27 04:46:07 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:08 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212" returned: 0 in 0.792s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:08 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b Jun 27 04:46:08 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:09 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b" returned: 0 in 0.914s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:09 devstack sudo[110163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b Jun 27 04:46:09 devstack sudo[110163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Flow 'volume_create_manager' (5f21568f-ab28-48ac-8f64-4bb39122990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68382fe2-9809-4f83-ad50-f0baa2aa52be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68382fe2-9809-4f83-ad50-f0baa2aa52be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1255867832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abca974-de6a-46fb-87e8-e0ff3c703b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54db922464640128f10f238dd25449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:09Z,use_quota=True,user_id='60abd7d2c95a480198db322ca68de063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1908dcf9-fea0-46b3-b1d7-e8736681dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1908dcf9-fea0-46b3-b1d7-e8736681dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042c1df1-dbc7-43f2-a828-2dc083bb3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042c1df1-dbc7-43f2-a828-2dc083bb3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abca974-de6a-46fb-87e8-e0ff3c703b49', 'volume_name': 'volume-7abca974-de6a-46fb-87e8-e0ff3c703b49', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160351a1-1af5-47cc-ac32-aef7235500a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160351a1-1af5-47cc-ac32-aef7235500a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b6e0a2-4404-4ca7-8e13-83d81a02d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Volume 7abca974-de6a-46fb-87e8-e0ff3c703b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abca974-de6a-46fb-87e8-e0ff3c703b49', 'volume_size': 1} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1255867832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abca974-de6a-46fb-87e8-e0ff3c703b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54db922464640128f10f238dd25449b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:09Z,use_quota=True,user_id='60abd7d2c95a480198db322ca68de063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Creating volume 7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:46:09 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:46:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:09 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 1073741824 Jun 27 04:46:09 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:10 devstack sudo[110163]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212.0d33e536-60f6-4706-992d-255479c2c59b" returned: 0 in 0.678s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-0d33e536-60f6-4706-992d-255479c2c59b" released by "_delete_snapshot" :: held 3.354s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-34611124-b2ba-4e44-acf9-4b87619b7212" released by "delete_snapshot" :: held 3.382s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Created reservations ['f6f6c3f0-85cf-4159-9a91-8e36e9664b3a', '65d44a5e-12c2-43a0-aa3f-2dc6fcafb6f0', '67636f61-3bef-40e0-9fc7-933a2867be8c', '91a320b8-e90c-4798-bb87-da0ceed3675d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:10 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Delete snapshot completed successfully. Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b3d745b-67db-429a-9716-0259dd70ebda tempest-VolumesExtendTest-763584526 None] Lock "cinder-0d33e536-60f6-4706-992d-255479c2c59b-delete_snapshot" released by "delete_snapshot" :: held 3.545s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:10 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 1073741824" returned: 0 in 0.969s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:10 devstack sudo[110172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 Jun 27 04:46:10 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-34611124-b2ba-4e44-acf9-4b87619b7212-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Lock "cinder-34611124-b2ba-4e44-acf9-4b87619b7212-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Acquiring lock "cinder-quobyte-34611124-b2ba-4e44-acf9-4b87619b7212" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-34611124-b2ba-4e44-acf9-4b87619b7212" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad41213-5a47-49c3-a8eb-b5a822f723e6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:11 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49" returned: 0 in 0.679s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b6e0a2-4404-4ca7-8e13-83d81a02d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abca974-de6a-46fb-87e8-e0ff3c703b49', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb73410b-a8b4-436f-adaf-f87db666a564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:11 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Volume volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 (7abca974-de6a-46fb-87e8-e0ff3c703b49): created successfully Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb73410b-a8b4-436f-adaf-f87db666a564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Flow 'volume_create_manager' (5f21568f-ab28-48ac-8f64-4bb39122990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-40e3f0bc-1aa5-4850-b9fe-cd36d346cbdd tempest-SnapshotMetadataTestJSON-1780931522 None] Created volume successfully. Jun 27 04:46:11 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 Jun 27 04:46:11 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Creating offline snapshot f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 of volume 7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc4163-36fc-4753-b9d9-598981013103]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:11 devstack sudo[110178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 Jun 27 04:46:11 devstack sudo[110178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:12 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212" returned: 0 in 0.898s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:12 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212 Jun 27 04:46:12 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:12 devstack sudo[110178]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49" returned: 0 in 0.843s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:12 devstack sudo[110188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 1G Jun 27 04:46:12 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:12 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-34611124-b2ba-4e44-acf9-4b87619b7212" returned: 0 in 0.747s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Lock "cinder-quobyte-34611124-b2ba-4e44-acf9-4b87619b7212" released by "delete_volume" :: held 1.708s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Created reservations ['ce34d53e-db7d-4bf9-8311-0805068c65fd', '634486da-b403-4193-b76f-e4302bb52715', '55a864f9-97c2-44a3-a4c9-72abbba3ced4', 'fd5e4801-a042-4c29-95a9-8e2caf98a816'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:13 devstack sudo[110191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:46:13 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:13 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 1G" returned: 0 in 0.956s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:13 devstack sudo[110197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 Jun 27 04:46:13 devstack sudo[110197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:13 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.778s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:13 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:46:13 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Deleted volume successfully. Jun 27 04:46:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ed65d53-a66a-458b-a091-eb5de6c6b8fe tempest-VolumesExtendTest-763584526 None] Lock "cinder-34611124-b2ba-4e44-acf9-4b87619b7212-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:14 devstack sudo[110197]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" returned: 0 in 0.754s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:14 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 is being set with open permissions: ugo+rw Jun 27 04:46:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:14 devstack sudo[110203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 Jun 27 04:46:14 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:15 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" returned: 0 in 0.924s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:15 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info Jun 27 04:46:15 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:16 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info" returned: 0 in 0.744s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:16 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info is being set with open permissions: ugo+rw Jun 27 04:46:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:16 devstack sudo[110246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info Jun 27 04:46:16 devstack sudo[110246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:16 devstack sudo[110246]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.info" returned: 0 in 0.681s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bcd69b7c-54f1-46c2-a6a6-1bb188c8ba25 tempest-SnapshotMetadataTestJSON-1780931522 None] Create snapshot completed successfully Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "cinder-f86d05b7-9b75-4cbc-a0c5-747143fc8cd7-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-f86d05b7-9b75-4cbc-a0c5-747143fc8cd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "cinder-quobyte-7abca974-de6a-46fb-87e8-e0ff3c703b49" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-quobyte-7abca974-de6a-46fb-87e8-e0ff3c703b49" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "cinder-quobyte-f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-quobyte-f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Deleting offline snapshot f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 of volume 7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] snapshot_file for this snap is: volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec38ea-760a-4fcb-8ad6-2a7b50999721]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:18 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 Jun 27 04:46:18 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:18 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" returned: 0 in 0.824s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abca974-de6a-46fb-87e8-e0ff3c703b49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d62522-c085-4ec0-abf3-5cd1392be49e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:18 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 Jun 27 04:46:18 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:19 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49" returned: 0 in 0.818s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:19 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 Jun 27 04:46:19 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:20 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" returned: 0 in 0.739s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:20 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7 Jun 27 04:46:20 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:20 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:46:20 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:21 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49.f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" returned: 0 in 0.774s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-quobyte-f86d05b7-9b75-4cbc-a0c5-747143fc8cd7" released by "_delete_snapshot" :: held 3.299s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-quobyte-7abca974-de6a-46fb-87e8-e0ff3c703b49" released by "delete_snapshot" :: held 3.331s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Created reservations ['21c08cc9-987b-4598-8917-a564e6dcc739', 'b6ba868d-bfbd-4d42-8d2c-20ed0b151daa', '7d8ad977-94a2-49ba-a187-3ecf221c9312', '43f68403-b953-4ed6-bff9-cc1c37dc4220'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Delete snapshot completed successfully. Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dc51e223-5841-47c0-a9a6-702e34a41314 tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-f86d05b7-9b75-4cbc-a0c5-747143fc8cd7-delete_snapshot" released by "delete_snapshot" :: held 3.545s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:21 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.806s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:46:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "cinder-7abca974-de6a-46fb-87e8-e0ff3c703b49-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-7abca974-de6a-46fb-87e8-e0ff3c703b49-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "cinder-quobyte-7abca974-de6a-46fb-87e8-e0ff3c703b49" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-quobyte-7abca974-de6a-46fb-87e8-e0ff3c703b49" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a49e5d-0959-4174-b333-a8672ba53e4b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:22 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 Jun 27 04:46:22 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:23 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:23 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49 Jun 27 04:46:23 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:23 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7abca974-de6a-46fb-87e8-e0ff3c703b49" returned: 0 in 0.663s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-quobyte-7abca974-de6a-46fb-87e8-e0ff3c703b49" released by "delete_volume" :: held 1.550s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Created reservations ['e3049a2e-91b1-48ab-bbe0-ecb3ba93ce5f', '689bcfda-b776-4d8e-b6f5-4cf7101293fe', 'cab333f0-5531-40e6-9138-09fa472440d9', 'e15dbc7b-d08f-45a4-a7fc-3e654d60f03e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:23 devstack sudo[110285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:46:23 devstack sudo[110285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:24 devstack sudo[110285]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.774s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:24 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:46:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Deleted volume successfully. Jun 27 04:46:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b26bcee-967b-41dd-a438-1ae2a723064e tempest-SnapshotMetadataTestJSON-1780931522 None] Lock "cinder-7abca974-de6a-46fb-87e8-e0ff3c703b49-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Flow 'volume_create_manager' (38e808f4-f043-4d6f-8c99-81ce549c83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067773e-897c-423e-a563-b4f74df7f83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067773e-897c-423e-a563-b4f74df7f83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1461871462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5246cf-63f6-41f3-8c90-6a1df0bfd018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcb8715f98a44db86ea5fc4c372d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:28Z,use_quota=True,user_id='f7522eb93daa45b79a537a39bbaa34f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8a117e-70b1-435a-8f7c-5b3e7d9a1ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8a117e-70b1-435a-8f7c-5b3e7d9a1ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1426eb-5c2b-4fa8-8dd7-3afe71db6909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1426eb-5c2b-4fa8-8dd7-3afe71db6909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5246cf-63f6-41f3-8c90-6a1df0bfd018', 'volume_name': 'volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8e523-8d24-4acc-a363-5f18142609e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c8e523-8d24-4acc-a363-5f18142609e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96aa652b-d2d3-49e2-b32f-43da00783fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:27 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Volume 5c5246cf-63f6-41f3-8c90-6a1df0bfd018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018', 'volume_size': 1} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1461871462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5246cf-63f6-41f3-8c90-6a1df0bfd018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcb8715f98a44db86ea5fc4c372d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:28Z,use_quota=True,user_id='f7522eb93daa45b79a537a39bbaa34f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Creating volume 5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:46:27 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:46:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:27 devstack sudo[110288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 1073741824 Jun 27 04:46:27 devstack sudo[110288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:28 devstack sudo[110288]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 1073741824" returned: 0 in 0.878s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:28 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:28 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:29 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.661s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96aa652b-d2d3-49e2-b32f-43da00783fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791ba1b3-fd01-4d37-828d-4f24da6421d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Volume volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 (5c5246cf-63f6-41f3-8c90-6a1df0bfd018): created successfully Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791ba1b3-fd01-4d37-828d-4f24da6421d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Flow 'volume_create_manager' (38e808f4-f043-4d6f-8c99-81ce549c83c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a4779407-daed-4b41-8692-c0b2e16501c1 tempest-VolumesDeleteCascade-626873502 None] Created volume successfully. Jun 27 04:46:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Creating offline snapshot a0ce809a-3e78-4867-93a8-fc6af91ef740 of volume 5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:46:30 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[56106caf-fcef-4f48-a1f1-042fe57fcb4e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:30 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:30 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:31 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.952s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:31 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 1G Jun 27 04:46:31 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:32 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 1G" returned: 0 in 1.031s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:32 devstack sudo[110309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:32 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:32 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.874s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:32 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 is being set with open permissions: ugo+rw Jun 27 04:46:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:32 devstack sudo[110314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:32 devstack sudo[110314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:33 devstack sudo[110314]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.727s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:33 devstack sudo[110317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info Jun 27 04:46:33 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:34 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info" returned: 0 in 0.668s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:34 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info is being set with open permissions: ugo+rw Jun 27 04:46:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:34 devstack sudo[110322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info Jun 27 04:46:34 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:35 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.info" returned: 0 in 0.725s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.090s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d8b46bfe-c587-435d-bc6c-d1ec4d10fa49 tempest-VolumesDeleteCascade-626873502 None] Create snapshot completed successfully Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Creating offline snapshot c0df8eb2-c396-493c-b932-4509223663d9 of volume 5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05ba5aa-8123-4be2-a5a2-b92eb8dcf18d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:35 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:35 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:36 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:36 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 1G Jun 27 04:46:36 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:37 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 1G" returned: 0 in 0.899s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:37 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 Jun 27 04:46:37 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:37 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9" returned: 0 in 0.715s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:37 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 is being set with open permissions: ugo+rw Jun 27 04:46:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:38 devstack sudo[110341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 Jun 27 04:46:38 devstack sudo[110341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:38 devstack sudo[110341]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9" returned: 0 in 0.648s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9b3f1a10-7974-490e-a73a-db9f64d4d994 tempest-VolumesDeleteCascade-626873502 None] Create snapshot completed successfully Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Flow 'volume_create_manager' (9cdbe2a6-ac0e-4111-8f63-4130d8a5ebc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1013446e-148f-42c5-ae97-7907c0dde99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1013446e-148f-42c5-ae97-7907c0dde99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-867335237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834fa5c8-b1ee-475d-9981-9ece14db464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6d79236b9248b4a118c84cfbe47909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:40Z,use_quota=True,user_id='c222d668b5774a5ebbe1df3b9360747e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344e8037-da21-4e02-b122-a6088b8f3684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344e8037-da21-4e02-b122-a6088b8f3684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87ac3d5-3a04-43aa-8af4-f4275392c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-5c5246cf-63f6-41f3-8c90-6a1df0bfd018-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-5c5246cf-63f6-41f3-8c90-6a1df0bfd018-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Performing cascade delete. {{(pid=93772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-a0ce809a-3e78-4867-93a8-fc6af91ef740-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-a0ce809a-3e78-4867-93a8-fc6af91ef740-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-a0ce809a-3e78-4867-93a8-fc6af91ef740" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-a0ce809a-3e78-4867-93a8-fc6af91ef740" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Deleting offline snapshot a0ce809a-3e78-4867-93a8-fc6af91ef740 of volume 5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] snapshot_file for this snap is: volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f1da37-5fad-4451-99e1-73c48fe09957]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:40 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:40 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87ac3d5-3a04-43aa-8af4-f4275392c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '834fa5c8-b1ee-475d-9981-9ece14db464b', 'volume_name': 'volume-834fa5c8-b1ee-475d-9981-9ece14db464b', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f9aad1-f5ba-406c-a006-a283b9b0300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f9aad1-f5ba-406c-a006-a283b9b0300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a414da3-5858-4723-9182-e8746b755f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:40 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Volume 834fa5c8-b1ee-475d-9981-9ece14db464b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-834fa5c8-b1ee-475d-9981-9ece14db464b', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Trying to clone 834fa5c8-b1ee-475d-9981-9ece14db464b from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:46:40 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Image download 20.69 MB at 20.69 MB/s Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[797c1e61-013a-4c7b-afe7-e2a2e97d0e9b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:40 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD Jun 27 04:46:40 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:40 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.882s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dcccda-7465-4bc5-8d9c-f651b76446c6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:40 devstack sudo[110352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:40 devstack sudo[110352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:41 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 is fetched for user c222d668b5774a5ebbe1df3b9360747e. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73d620-982f-4274-a9d5-59d7d9ba3e29]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:41 devstack sudo[110357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD Jun 27 04:46:41 devstack sudo[110357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:41 devstack sudo[110352]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.768s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f0cc9-9300-46e9-9dec-ad0f8acd05e2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:41 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 Jun 27 04:46:41 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:42 devstack sudo[110357]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-867335237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834fa5c8-b1ee-475d-9981-9ece14db464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e6d79236b9248b4a118c84cfbe47909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:40Z,use_quota=True,user_id='c222d668b5774a5ebbe1df3b9360747e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Creating volume 834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:46:42 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:42 devstack sudo[110368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b 1073741824 Jun 27 04:46:42 devstack sudo[110368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:42 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9" returned: 0 in 0.768s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8315b45d-4567-4d4c-b86f-6b9c885c8a7c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:42 devstack sudo[110373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:42 devstack sudo[110373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:42 devstack sudo[110368]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b 1073741824" returned: 0 in 0.848s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:43 devstack sudo[110373]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.766s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[351332f9-7627-4f71-943a-41c3a1bcf0fb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:43 devstack sudo[110381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:46:43 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:43 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:43 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:43 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 0.625s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Attempting download of 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume 834fa5c8-b1ee-475d-9981-9ece14db464b. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ae0d0-1733-4f8e-84d9-c51b3b1b12bd]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:44 devstack sudo[110390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f Jun 27 04:46:44 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:44 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.803s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:44 devstack sudo[110392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:44 devstack sudo[110392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:44 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f" returned: 0 in 0.765s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:44 devstack sudo[110392]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.717s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:44 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740 Jun 27 04:46:44 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:44 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f Jun 27 04:46:44 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:45 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f" returned: 1 in 0.710s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65172e40-e60b-42ac-beb4-f7bdf5b877f2_69vbp51f' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:46:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898d043-4de1-4f43-945e-6f0aa28398b8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:45 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.a0ce809a-3e78-4867-93a8-fc6af91ef740" returned: 0 in 0.698s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 -F qcow2 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:45 devstack sudo[110407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 -F qcow2 Jun 27 04:46:45 devstack sudo[110407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:45 devstack sudo[110406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD Jun 27 04:46:45 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:46 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:46 devstack sudo[110407]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] 65172e40-e60b-42ac-beb4-f7bdf5b877f2 was qcow2, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 -F qcow2" returned: 0 in 0.688s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:46 devstack sudo[110416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:46:46 devstack sudo[110416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-a0ce809a-3e78-4867-93a8-fc6af91ef740" released by "_delete_snapshot" :: held 6.306s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" released by "delete_snapshot" :: held 6.339s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=85,cinder:SELECT=72,cinder:INSERT=25,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=78,cinder:DELETE=7 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Created reservations ['56e3d812-917d-415b-bccb-56b2b48cad0f', 'caae5e1e-403d-485d-8068-7d678e63f03b', '3334155b-da47-4498-94e7-543d587d5ed4', '3bee1ab4-c5b1-42e2-a73a-baa52dacdbd7'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:46 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Delete snapshot completed successfully. Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-a0ce809a-3e78-4867-93a8-fc6af91ef740-delete_snapshot" released by "delete_snapshot" :: held 6.508s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-c0df8eb2-c396-493c-b932-4509223663d9-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-c0df8eb2-c396-493c-b932-4509223663d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-c0df8eb2-c396-493c-b932-4509223663d9" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-c0df8eb2-c396-493c-b932-4509223663d9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Deleting offline snapshot c0df8eb2-c396-493c-b932-4509223663d9 of volume 5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] snapshot_file for this snap is: volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a081fa-51c7-477e-99b3-6ca15f98a24e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:46 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 Jun 27 04:46:46 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:47 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9" returned: 0 in 0.879s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:46:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68f6d97-e9fb-408f-a6fc-dc23e9a4341c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:47 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:47 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:48 devstack sudo[110416]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 1.965s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65172e40-e60b-42ac-beb4-f7bdf5b877f2_cxl3z8oadevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:46:48 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Converted 112.00 MB image at 56.96 MB/s Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:48 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b 1G Jun 27 04:46:48 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:48 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.900s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:48 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 Jun 27 04:46:48 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:48 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b 1G" returned: 0 in 0.705s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[62780038-7963-44ca-84b9-fa803e2308ad]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:49 devstack sudo[110446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:46:49 devstack sudo[110446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:49 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9" returned: 0 in 0.870s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:49 devstack sudo[110449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9 Jun 27 04:46:49 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:49 devstack sudo[110446]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:49 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:46:49 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:49 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018.c0df8eb2-c396-493c-b932-4509223663d9" returned: 0 in 0.851s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-c0df8eb2-c396-493c-b932-4509223663d9" released by "_delete_snapshot" :: held 3.620s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" released by "delete_snapshot" :: held 3.649s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Created reservations ['07d5974b-4bd6-4ef6-8402-3451dd266f7d', 'b6ac1eb8-b516-42ae-8df7-2a796d2c0635', '78aa8328-2773-47f8-bd40-e076419bcbda', 'b31d1702-2f77-4fbf-aab6-c95be23cd5f8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Delete snapshot completed successfully. Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-c0df8eb2-c396-493c-b932-4509223663d9-delete_snapshot" released by "delete_snapshot" :: held 3.826s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Snapshots deleted, issuing volume delete {{(pid=93772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" acquired by "delete_volume" :: waited 0.033s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaab801-775c-4359-b8ba-c133826e9567]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:50 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:50 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:50 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 1 in 0.761s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Downloaded image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}])) to volume 834fa5c8-b1ee-475d-9981-9ece14db464b successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Temporary image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 for user c222d668b5774a5ebbe1df3b9360747e is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Marking volume 834fa5c8-b1ee-475d-9981-9ece14db464b as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Copying metadata from image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 to 834fa5c8-b1ee-475d-9981-9ece14db464b. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Creating volume glance metadata for volume 834fa5c8-b1ee-475d-9981-9ece14db464b backed by image 65172e40-e60b-42ac-beb4-f7bdf5b877f2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a414da3-5858-4723-9182-e8746b755f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834fa5c8-b1ee-475d-9981-9ece14db464b', 'volume_size': 1, 'image_id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '85c06b4402dd4b55ae206cf2d2c9903e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '65172e40-e60b-42ac-beb4-f7bdf5b877f2', 'created_at': datetime.datetime(2026, 6, 27, 2, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 22, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65172e40-e60b-42ac-beb4-f7bdf5b877f2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5b9473-7179-484b-9799-f1e121f03604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Volume volume-834fa5c8-b1ee-475d-9981-9ece14db464b (834fa5c8-b1ee-475d-9981-9ece14db464b): created successfully Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5b9473-7179-484b-9799-f1e121f03604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Flow 'volume_create_manager' (9cdbe2a6-ac0e-4111-8f63-4130d8a5ebc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1632f70f-8c32-42ed-a056-47f36f05b4d4 tempest-TestShelveInstance-1767269831 None] Created volume successfully. Jun 27 04:46:51 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.794s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:51 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018 Jun 27 04:46:51 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:51 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" returned: 0 in 0.698s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-5c5246cf-63f6-41f3-8c90-6a1df0bfd018" released by "delete_volume" :: held 1.565s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Created reservations ['ce3ca0f5-7d94-4796-a0ef-40123c432964', '4e247563-84f7-4f66-b963-54fc4b0301a7', '28af8a55-76a4-41b2-927c-0a7a3d150794', '24e31198-29f3-4a59-9ce0-141f40dccaa8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:51 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:46:51 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:52 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.705s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:52 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:46:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Deleted volume successfully. Jun 27 04:46:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2c14b7a6-e21c-42bd-b3bf-822e0ead1e9d tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-5c5246cf-63f6-41f3-8c90-6a1df0bfd018-delete_volume" released by "delete_volume" :: held 12.901s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Flow 'volume_create_manager' (a9c4f7f9-0a1a-4331-ad8d-625823326c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09de40f5-af69-4127-92fe-5b40d6f0e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09de40f5-af69-4127-92fe-5b40d6f0e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-83710229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf58816-ab6a-4b15-929d-295f75529bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcb8715f98a44db86ea5fc4c372d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:53Z,use_quota=True,user_id='f7522eb93daa45b79a537a39bbaa34f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38155ce-85d0-4d83-80d0-85426893c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38155ce-85d0-4d83-80d0-85426893c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b7554-2178-4502-bf05-d55ff3a93983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b7554-2178-4502-bf05-d55ff3a93983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf58816-ab6a-4b15-929d-295f75529bfc', 'volume_name': 'volume-7cf58816-ab6a-4b15-929d-295f75529bfc', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1b663c-0879-4e37-a5a2-c9902d0b302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a1b663c-0879-4e37-a5a2-c9902d0b302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddbc4fb-efd5-4105-8909-5e20bce957b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:53 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Volume 7cf58816-ab6a-4b15-929d-295f75529bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf58816-ab6a-4b15-929d-295f75529bfc', 'volume_size': 1} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-83710229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf58816-ab6a-4b15-929d-295f75529bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcb8715f98a44db86ea5fc4c372d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:46:53Z,use_quota=True,user_id='f7522eb93daa45b79a537a39bbaa34f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Creating volume 7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:46:53 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:46:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:53 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc 1073741824 Jun 27 04:46:53 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:54 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc 1073741824" returned: 0 in 0.841s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:54 devstack sudo[110479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:46:54 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:54 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 0.631s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddbc4fb-efd5-4105-8909-5e20bce957b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf58816-ab6a-4b15-929d-295f75529bfc', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6090dc4-9eb9-424c-bd24-065022bf3613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:46:54 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Volume volume-7cf58816-ab6a-4b15-929d-295f75529bfc (7cf58816-ab6a-4b15-929d-295f75529bfc): created successfully Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6090dc4-9eb9-424c-bd24-065022bf3613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:46:54 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Flow 'volume_create_manager' (a9c4f7f9-0a1a-4331-ad8d-625823326c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:46:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-823bad3f-b190-46d1-ba78-fee2969900f9 tempest-VolumesDeleteCascade-626873502 None] Created volume successfully. Jun 27 04:46:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:46:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Creating offline snapshot 8893e252-9e6a-45ed-8469-7c340fa469cc of volume 7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:46:55 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[22686dbf-988e-4584-9525-b93ab955cee4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:46:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:55 devstack sudo[110482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:46:55 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:56 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 0.736s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:56 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc 1G Jun 27 04:46:56 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:57 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc 1G" returned: 0 in 0.824s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf58816-ab6a-4b15-929d-295f75529bfc -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:57 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf58816-ab6a-4b15-929d-295f75529bfc -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc Jun 27 04:46:57 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:57 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cf58816-ab6a-4b15-929d-295f75529bfc -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc" returned: 0 in 0.724s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:57 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc is being set with open permissions: ugo+rw Jun 27 04:46:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:57 devstack sudo[110498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc Jun 27 04:46:57 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:58 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc" returned: 0 in 0.743s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:58 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info Jun 27 04:46:58 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:46:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:46:59 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Jun 27 04:46:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info" returned: 0 in 0.693s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:46:59 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info is being set with open permissions: ugo+rw Jun 27 04:46:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:46:59 devstack sudo[110513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info Jun 27 04:46:59 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:00 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.info" returned: 0 in 0.711s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.527s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.818s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d58cb7ea-aaef-4975-870d-fa90bc8dcbc0 tempest-VolumesDeleteCascade-626873502 None] Create snapshot completed successfully Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930b28c-c686-49ed-a0b9-8fba8c77a00a]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:00 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:47:00 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:00 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 0.793s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:01 devstack sudo[110521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:47:01 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Flow 'volume_create_manager' (c703367d-f382-4864-91af-78a3eac69ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396384c5-eb85-49ce-bb9a-06c538a8e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396384c5-eb85-49ce-bb9a-06c538a8e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-14473495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a05b6b-5673-468c-a9b3-944372a41215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcb8715f98a44db86ea5fc4c372d3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8893e252-9e6a-45ed-8469-7c340fa469cc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:01Z,use_quota=True,user_id='f7522eb93daa45b79a537a39bbaa34f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d7dcfa-50ae-4a8e-a050-219726bb87c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d7dcfa-50ae-4a8e-a050-219726bb87c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb29ef23-eebf-4433-91da-fad4a7752d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb29ef23-eebf-4433-91da-fad4a7752d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52a05b6b-5673-468c-a9b3-944372a41215', 'volume_name': 'volume-52a05b6b-5673-468c-a9b3-944372a41215', 'volume_size': 1, 'snapshot_id': '8893e252-9e6a-45ed-8469-7c340fa469cc'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc7514-2c72-426d-ad2f-3fb46f888aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc7514-2c72-426d-ad2f-3fb46f888aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6e00a2-3aa2-4000-993d-8545157bd27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Volume 52a05b6b-5673-468c-a9b3-944372a41215: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52a05b6b-5673-468c-a9b3-944372a41215', 'volume_size': 1, 'snapshot_id': '8893e252-9e6a-45ed-8469-7c340fa469cc'} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:01 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 1 in 0.884s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.717s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.267s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-8893e252-9e6a-45ed-8469-7c340fa469cc-52a05b6b-5673-468c-a9b3-944372a41215" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-8893e252-9e6a-45ed-8469-7c340fa469cc-52a05b6b-5673-468c-a9b3-944372a41215" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Creating volume 52a05b6b-5673-468c-a9b3-944372a41215 from snapshot 8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-52a05b6b-5673-468c-a9b3-944372a41215" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-52a05b6b-5673-468c-a9b3-944372a41215" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] snapshot: 8893e252-9e6a-45ed-8469-7c340fa469cc, volume: 52a05b6b-5673-468c-a9b3-944372a41215, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-834fa5c8-b1ee-475d-9981-9ece14db464b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bda4ab26-16ca-466a-bb79-07351a499b14', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba85a7-1d90-4f9c-8fc2-840b9c481304]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:02 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-ec22f9bd-e3eb-4398-bbbd-dc1b7c800561 req-3268cd03-e90c-4a44-9a8c-6bf957ac9bf5 tempest-TestShelveInstance-1767269831 None] attachment_update completed successfully. Jun 27 04:47:02 devstack sudo[110527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc Jun 27 04:47:02 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:02 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc" returned: 0 in 0.930s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf58816-ab6a-4b15-929d-295f75529bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:47:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:47:02 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:47:02 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c5dc6-2e5a-4fe1-ae8e-d27ad1c665ca]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:03 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:47:03 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:03 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 0.926s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:03 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:47:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:03 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 Jun 27 04:47:03 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:09 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215" returned: 0 in 5.389s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b04f81-1483-4991-8553-fde5faaebf02]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:09 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:47:09 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:10 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 1.080s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:10 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:47:10 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Converted 1024.00 MB image at 189.98 MB/s Jun 27 04:47:10 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 is being set with open permissions: ugo+rw Jun 27 04:47:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:10 devstack sudo[111015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 Jun 27 04:47:10 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:10 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215" returned: 0 in 0.677s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-52a05b6b-5673-468c-a9b3-944372a41215" released by "_copy_volume_from_snapshot" :: held 9.151s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-8893e252-9e6a-45ed-8469-7c340fa469cc-52a05b6b-5673-468c-a9b3-944372a41215" released by "_create_volume_from_snapshot" :: held 9.198s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.221s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6e00a2-3aa2-4000-993d-8545157bd27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a05b6b-5673-468c-a9b3-944372a41215', 'volume_size': 1, 'snapshot_id': '8893e252-9e6a-45ed-8469-7c340fa469cc'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92be029f-75a3-4f73-814e-b4d215be6501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:11 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Volume volume-52a05b6b-5673-468c-a9b3-944372a41215 (52a05b6b-5673-468c-a9b3-944372a41215): created successfully Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92be029f-75a3-4f73-814e-b4d215be6501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Flow 'volume_create_manager' (c703367d-f382-4864-91af-78a3eac69ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f6b083b8-21e3-45ef-93ab-ee03e9f93803 tempest-VolumesDeleteCascade-626873502 None] Created volume successfully. Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-7cf58816-ab6a-4b15-929d-295f75529bfc-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-7cf58816-ab6a-4b15-929d-295f75529bfc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Performing cascade delete. {{(pid=93772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-8893e252-9e6a-45ed-8469-7c340fa469cc-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-8893e252-9e6a-45ed-8469-7c340fa469cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-7cf58816-ab6a-4b15-929d-295f75529bfc" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-7cf58816-ab6a-4b15-929d-295f75529bfc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-8893e252-9e6a-45ed-8469-7c340fa469cc" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-8893e252-9e6a-45ed-8469-7c340fa469cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Deleting offline snapshot 8893e252-9e6a-45ed-8469-7c340fa469cc of volume 7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] snapshot_file for this snap is: volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f759dbe5-fea1-45ef-8364-2d68783b305f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:11 devstack sudo[111020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc Jun 27 04:47:11 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:12 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cf58816-ab6a-4b15-929d-295f75529bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:47:12 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d660f98-8719-43c0-b8b3-a84ec57f26f7]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:12 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:47:12 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:13 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 0.855s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:13 devstack sudo[111031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc Jun 27 04:47:13 devstack sudo[111031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:14 devstack sudo[111031]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc" returned: 0 in 0.884s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:14 devstack sudo[111038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc Jun 27 04:47:14 devstack sudo[111038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:15 devstack sudo[111038]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc.8893e252-9e6a-45ed-8469-7c340fa469cc" returned: 0 in 0.825s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-8893e252-9e6a-45ed-8469-7c340fa469cc" released by "_delete_snapshot" :: held 3.508s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-7cf58816-ab6a-4b15-929d-295f75529bfc" released by "delete_snapshot" :: held 3.541s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Created reservations ['df60e4b8-fde5-4243-9024-ad5bc7739e40', '23f7a9f0-89fe-40c4-be14-372d91de055c', '0dd1c45d-8e86-472b-bbf6-539f2db4ac0d', '664710ae-efe2-4325-b0e3-80055e3b2a3c'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:15 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Delete snapshot completed successfully. Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-8893e252-9e6a-45ed-8469-7c340fa469cc-delete_snapshot" released by "delete_snapshot" :: held 3.749s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Snapshots deleted, issuing volume delete {{(pid=93772) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-7cf58816-ab6a-4b15-929d-295f75529bfc" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-7cf58816-ab6a-4b15-929d-295f75529bfc" acquired by "delete_volume" :: waited 0.042s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e982b79-bccb-4297-adbe-15cc3c8b218d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:15 devstack sudo[111076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:47:15 devstack sudo[111076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:16 devstack sudo[111076]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 0.851s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:16 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc Jun 27 04:47:16 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:16 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-7cf58816-ab6a-4b15-929d-295f75529bfc" returned: 0 in 0.636s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-7cf58816-ab6a-4b15-929d-295f75529bfc" released by "delete_volume" :: held 1.591s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:16 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Created reservations ['0cfc8cd1-573b-49c4-9701-d806a0ced6ba', '044ef1cc-41df-49fd-881a-c6443fcfa402', 'e68a54b0-5588-4eb8-8214-05fd968cfa6d', '4d76e0ce-06d2-4a39-a62b-bd0049f51e5e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:17 devstack sudo[111087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:17 devstack sudo[111087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:17 devstack sudo[111087]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.641s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:17 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Deleted volume successfully. Jun 27 04:47:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5543de84-78cc-4a21-886a-3e44f2e34680 tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-7cf58816-ab6a-4b15-929d-295f75529bfc-delete_volume" released by "delete_volume" :: held 6.286s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-52a05b6b-5673-468c-a9b3-944372a41215-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-52a05b6b-5673-468c-a9b3-944372a41215-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "cinder-quobyte-52a05b6b-5673-468c-a9b3-944372a41215" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-52a05b6b-5673-468c-a9b3-944372a41215" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:18 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db051c-1f13-4328-8c0e-b79c418c4b6c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:18 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 Jun 27 04:47:18 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:19 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215" returned: 0 in 0.758s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:19 devstack sudo[111101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215 Jun 27 04:47:19 devstack sudo[111101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:19 devstack sudo[111101]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52a05b6b-5673-468c-a9b3-944372a41215" returned: 0 in 0.649s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-quobyte-52a05b6b-5673-468c-a9b3-944372a41215" released by "delete_volume" :: held 1.456s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Created reservations ['0a854bc3-7b18-4a59-b12b-f9916be06577', 'ab59fd24-5191-40ab-a61a-4a8f69be9c17', 'c4c6e93f-0f9c-4bb0-8593-dc7284052b72', 'ff0ae4b3-6093-49b6-a62d-e3daa0112b53'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:19 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:19 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:20 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.697s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:20 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Deleted volume successfully. Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fb260d45-3253-4893-b13b-bdf28010afde tempest-VolumesDeleteCascade-626873502 None] Lock "cinder-52a05b6b-5673-468c-a9b3-944372a41215-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:20 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:20 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:21 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Flow 'volume_create_manager' (ae3ae22e-e6ae-45e5-8185-a4cc9617a8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6142ec25-c3af-4803-9c77-b6c695233a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6142ec25-c3af-4803-9c77-b6c695233a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-856584335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30d6451-a43e-4aa3-9b68-ca18150a907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e3934f4c79449d9d168cfd6bb202bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:25Z,use_quota=True,user_id='53036e0a1ad34ffca916269a33f70eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3104d096-266c-4440-9210-a01f174e495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3104d096-266c-4440-9210-a01f174e495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d9a553-ff0c-453c-8bb6-b0125b4b6f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d9a553-ff0c-453c-8bb6-b0125b4b6f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30d6451-a43e-4aa3-9b68-ca18150a907e', 'volume_name': 'volume-c30d6451-a43e-4aa3-9b68-ca18150a907e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0661c-5290-4075-8f4a-ae4f4cd08062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff0661c-5290-4075-8f4a-ae4f4cd08062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6682f8-0f02-449f-883a-0fb0d1ef7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:25 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Volume c30d6451-a43e-4aa3-9b68-ca18150a907e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30d6451-a43e-4aa3-9b68-ca18150a907e', 'volume_size': 1} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-856584335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30d6451-a43e-4aa3-9b68-ca18150a907e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e3934f4c79449d9d168cfd6bb202bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:25Z,use_quota=True,user_id='53036e0a1ad34ffca916269a33f70eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Creating volume c30d6451-a43e-4aa3-9b68-ca18150a907e {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:47:25 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:47:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:25 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e 1073741824 Jun 27 04:47:25 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:26 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e 1073741824" returned: 0 in 0.846s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:26 devstack sudo[111209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e Jun 27 04:47:26 devstack sudo[111209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:27 devstack sudo[111209]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e" returned: 0 in 0.636s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6682f8-0f02-449f-883a-0fb0d1ef7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30d6451-a43e-4aa3-9b68-ca18150a907e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049caf11-419d-43b4-855c-90ffd82271ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:27 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Volume volume-c30d6451-a43e-4aa3-9b68-ca18150a907e (c30d6451-a43e-4aa3-9b68-ca18150a907e): created successfully Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049caf11-419d-43b4-855c-90ffd82271ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:27 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Flow 'volume_create_manager' (ae3ae22e-e6ae-45e5-8185-a4cc9617a8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:27 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-08428104-139d-405d-a9ea-18036e5ec2f1 tempest-VolumesTransfersV357Test-1289321119 None] Created volume successfully. Jun 27 04:47:28 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d5fe51c3-e4e6-4d76-b5ef-77863c440764 tempest-VolumesTransfersV357Test-2145509810 None] Transfer volume completed successfully. Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Acquiring lock "cinder-c30d6451-a43e-4aa3-9b68-ca18150a907e-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-c30d6451-a43e-4aa3-9b68-ca18150a907e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Acquiring lock "cinder-quobyte-c30d6451-a43e-4aa3-9b68-ca18150a907e" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-quobyte-c30d6451-a43e-4aa3-9b68-ca18150a907e" acquired by "delete_volume" :: waited 0.015s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a73a3-4e64-4293-ab3f-d33258f77c99]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:29 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e Jun 27 04:47:29 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:29 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e" returned: 0 in 0.773s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:29 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e Jun 27 04:47:29 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:30 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c30d6451-a43e-4aa3-9b68-ca18150a907e" returned: 0 in 0.659s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-quobyte-c30d6451-a43e-4aa3-9b68-ca18150a907e" released by "delete_volume" :: held 1.473s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Created reservations ['7abf2cc2-9f7f-417f-9111-a068842c76d2', '2ba79884-dbd1-4dfd-bac8-6e380da891f7', 'c7bddd9d-66f5-4b0d-b083-1906719dd5b8', '71ac6b55-ecb4-49c4-94f5-e1b25b82ca8d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:30 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:30 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:31 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.653s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Deleted volume successfully. Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9462d78e-5731-47ec-b9bf-30a674a9489d tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-c30d6451-a43e-4aa3-9b68-ca18150a907e-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Flow 'volume_create_manager' (125eb4e2-e2e8-4924-95f5-664bcf080184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fbd252-fac7-4f67-ad5c-a4bca33614a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fbd252-fac7-4f67-ad5c-a4bca33614a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-50110751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78026612-ef9f-4106-b0ad-9a0d8f2cce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e3934f4c79449d9d168cfd6bb202bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:32Z,use_quota=True,user_id='53036e0a1ad34ffca916269a33f70eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e8e468-afae-47ea-9b57-3fd0c0f154b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e8e468-afae-47ea-9b57-3fd0c0f154b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f398e02-9f45-48bc-b871-fd9a6d3a1ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f398e02-9f45-48bc-b871-fd9a6d3a1ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78026612-ef9f-4106-b0ad-9a0d8f2cce33', 'volume_name': 'volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2f765f-0c00-4ca1-a8a3-ea812f3301ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2f765f-0c00-4ca1-a8a3-ea812f3301ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb45b18d-0ac2-453e-90f3-525b98a6d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:31 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Volume 78026612-ef9f-4106-b0ad-9a0d8f2cce33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33', 'volume_size': 1} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-50110751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78026612-ef9f-4106-b0ad-9a0d8f2cce33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e3934f4c79449d9d168cfd6bb202bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:32Z,use_quota=True,user_id='53036e0a1ad34ffca916269a33f70eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Creating volume 78026612-ef9f-4106-b0ad-9a0d8f2cce33 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:47:31 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:47:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:31 devstack sudo[111225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 1073741824 Jun 27 04:47:31 devstack sudo[111225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:32 devstack sudo[111225]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 1073741824" returned: 0 in 0.844s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:32 devstack sudo[111230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 Jun 27 04:47:32 devstack sudo[111230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:33 devstack sudo[111230]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33" returned: 0 in 0.650s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb45b18d-0ac2-453e-90f3-525b98a6d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f60b40d-bfad-4d1d-9c87-97e64d2c4037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:33 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Volume volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 (78026612-ef9f-4106-b0ad-9a0d8f2cce33): created successfully Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f60b40d-bfad-4d1d-9c87-97e64d2c4037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Flow 'volume_create_manager' (125eb4e2-e2e8-4924-95f5-664bcf080184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:33 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bde0bb41-79c9-43d3-b59c-e02831b8983a tempest-VolumesTransfersV357Test-1289321119 None] Created volume successfully. Jun 27 04:47:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Acquiring lock "cinder-78026612-ef9f-4106-b0ad-9a0d8f2cce33-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-78026612-ef9f-4106-b0ad-9a0d8f2cce33-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Acquiring lock "cinder-quobyte-78026612-ef9f-4106-b0ad-9a0d8f2cce33" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-quobyte-78026612-ef9f-4106-b0ad-9a0d8f2cce33" acquired by "delete_volume" :: waited 0.015s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:34 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b9bb50-0801-4710-9b87-133351c9d8a0]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:34 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 Jun 27 04:47:34 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:35 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33" returned: 0 in 0.857s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:35 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33 Jun 27 04:47:35 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:35 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-78026612-ef9f-4106-b0ad-9a0d8f2cce33" returned: 0 in 0.640s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-quobyte-78026612-ef9f-4106-b0ad-9a0d8f2cce33" released by "delete_volume" :: held 1.540s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Created reservations ['868226aa-5a2f-42cb-80e4-f1b684412481', '0a8c7f58-a9d3-4d7a-bcec-fa9441a4d7a6', 'a4103c16-2fdf-4444-a6ab-a82f1b7e146b', '0c886a63-dbc1-4010-b1cd-3f6bbfa4dba4'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:36 devstack sudo[111243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:36 devstack sudo[111243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:36 devstack sudo[111243]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.685s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Deleted volume successfully. Jun 27 04:47:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d09a616f-dc79-4175-b412-e373eea21f70 tempest-VolumesTransfersV357Test-1520807227 None] Lock "cinder-78026612-ef9f-4106-b0ad-9a0d8f2cce33-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Flow 'volume_create_manager' (407e3ba5-a889-4af7-a2ec-9bf83d4462e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed57aa2-15a5-4485-aead-360bfe0b4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed57aa2-15a5-4485-aead-360bfe0b4996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1321224071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000e90a9-4d23-4c5b-8885-4ce5beaa84d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd799f1e60fa4dcdb9fb4856d46ced0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:42Z,use_quota=True,user_id='4adac860684746ddabc8b69a224ed38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42281a54-72a1-4ba5-af00-b52b0f9e8cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42281a54-72a1-4ba5-af00-b52b0f9e8cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b62c71-5952-4388-9776-1768b816ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b62c71-5952-4388-9776-1768b816ff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000e90a9-4d23-4c5b-8885-4ce5beaa84d3', 'volume_name': 'volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b38529-613e-4aac-8e7e-76b0e090474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b38529-613e-4aac-8e7e-76b0e090474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd68c2-b8a8-4454-bc57-81021a331aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:42 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Volume 000e90a9-4d23-4c5b-8885-4ce5beaa84d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3', 'volume_size': 1} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1321224071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000e90a9-4d23-4c5b-8885-4ce5beaa84d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd799f1e60fa4dcdb9fb4856d46ced0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:42Z,use_quota=True,user_id='4adac860684746ddabc8b69a224ed38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Creating volume 000e90a9-4d23-4c5b-8885-4ce5beaa84d3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:47:42 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:47:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:42 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 1073741824 Jun 27 04:47:42 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:43 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 1073741824" returned: 0 in 1.058s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:43 devstack sudo[111308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 Jun 27 04:47:43 devstack sudo[111308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:43 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-59ba8527-b89d-4c5f-be9d-f80348c56340 req-493004ac-5943-4d5d-9290-8ea7d8af4c8d tempest-TestShelveInstance-1767269831 None] Terminate volume connection completed successfully. Jun 27 04:47:43 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-59ba8527-b89d-4c5f-be9d-f80348c56340 req-493004ac-5943-4d5d-9290-8ea7d8af4c8d tempest-TestShelveInstance-1767269831 None] Deleting attachment bda4ab26-16ca-466a-bb79-07351a499b14. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:47:44 devstack sudo[111308]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3" returned: 0 in 0.677s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15cd68c2-b8a8-4454-bc57-81021a331aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7277856f-d5a4-4b99-815f-dbe3d488190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:44 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Volume volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 (000e90a9-4d23-4c5b-8885-4ce5beaa84d3): created successfully Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7277856f-d5a4-4b99-815f-dbe3d488190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Flow 'volume_create_manager' (407e3ba5-a889-4af7-a2ec-9bf83d4462e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f8991107-ddbd-4f04-a86a-14c474067ff2 tempest-VolumesListTestJSON-648063332 None] Created volume successfully. Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Flow 'volume_create_manager' (d6124908-0e8a-4ced-bb6d-803e138e4a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95db3edf-2ec4-4236-997e-75e8e53e56af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95db3edf-2ec4-4236-997e-75e8e53e56af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1448692120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702aab3b-3568-4e74-a412-0d2e17ba8fbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd799f1e60fa4dcdb9fb4856d46ced0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:45Z,use_quota=True,user_id='4adac860684746ddabc8b69a224ed38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f8cc33-05a3-4bd0-bfa4-994d065f26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f8cc33-05a3-4bd0-bfa4-994d065f26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81a5a94-4db0-4932-b51d-95473b1d5a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81a5a94-4db0-4932-b51d-95473b1d5a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702aab3b-3568-4e74-a412-0d2e17ba8fbf', 'volume_name': 'volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccd2e00-b9f2-4a33-b257-1d2ebd3465cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccd2e00-b9f2-4a33-b257-1d2ebd3465cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de75ca6-a6be-41d3-9c43-76ba17ad02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:44 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Volume 702aab3b-3568-4e74-a412-0d2e17ba8fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf', 'volume_size': 1} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1448692120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702aab3b-3568-4e74-a412-0d2e17ba8fbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd799f1e60fa4dcdb9fb4856d46ced0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:45Z,use_quota=True,user_id='4adac860684746ddabc8b69a224ed38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Creating volume 702aab3b-3568-4e74-a412-0d2e17ba8fbf {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:47:44 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:47:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:45 devstack sudo[111311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf 1073741824 Jun 27 04:47:45 devstack sudo[111311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:45 devstack sudo[111311]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf 1073741824" returned: 0 in 0.935s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:46 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf Jun 27 04:47:46 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:46 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=69,cinder:INSERT=27,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de75ca6-a6be-41d3-9c43-76ba17ad02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee38884-b79e-48df-80d8-3b6021a218d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:INSERT=23,cinder:UPDATE=74,cinder:SELECT=66,cinder:DELETE=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:47:46 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Volume volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf (702aab3b-3568-4e74-a412-0d2e17ba8fbf): created successfully Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee38884-b79e-48df-80d8-3b6021a218d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Flow 'volume_create_manager' (d6124908-0e8a-4ced-bb6d-803e138e4a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:46 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4b33b8f6-fd0b-4615-a48c-7a38cfbcda18 tempest-VolumesListTestJSON-648063332 None] Created volume successfully. Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Flow 'volume_create_manager' (fdbed6b5-7958-4a0c-9d47-56f53cc0da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b594279-aaa2-4e61-aa47-2dded9f7b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b594279-aaa2-4e61-aa47-2dded9f7b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1429958951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71689211-11ca-4416-9f1e-1298be7a2fb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd799f1e60fa4dcdb9fb4856d46ced0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:47Z,use_quota=True,user_id='4adac860684746ddabc8b69a224ed38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c5855-94a3-4a3d-999f-45151a34bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c5855-94a3-4a3d-999f-45151a34bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef1eb23-21d2-4190-8ecb-b021cc4fc300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef1eb23-21d2-4190-8ecb-b021cc4fc300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71689211-11ca-4416-9f1e-1298be7a2fb0', 'volume_name': 'volume-71689211-11ca-4416-9f1e-1298be7a2fb0', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db8b641-3ade-4795-8c5e-67b2f74143e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db8b641-3ade-4795-8c5e-67b2f74143e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39281e54-c248-4c49-b9e4-efa44a36df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:47 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Volume 71689211-11ca-4416-9f1e-1298be7a2fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71689211-11ca-4416-9f1e-1298be7a2fb0', 'volume_size': 1} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1429958951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71689211-11ca-4416-9f1e-1298be7a2fb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bd799f1e60fa4dcdb9fb4856d46ced0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:47:47Z,use_quota=True,user_id='4adac860684746ddabc8b69a224ed38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Creating volume 71689211-11ca-4416-9f1e-1298be7a2fb0 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:47:47 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:47:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:47 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 1073741824 Jun 27 04:47:47 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:48 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 1073741824" returned: 0 in 0.862s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:48 devstack sudo[111329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 Jun 27 04:47:48 devstack sudo[111329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:49 devstack sudo[111329]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0" returned: 0 in 0.659s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.076s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39281e54-c248-4c49-b9e4-efa44a36df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71689211-11ca-4416-9f1e-1298be7a2fb0', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97a8373-9450-49df-91d4-1b67cc83424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[32387428-5333-462d-833c-9ee0d2e62efb]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:49 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Volume volume-71689211-11ca-4416-9f1e-1298be7a2fb0 (71689211-11ca-4416-9f1e-1298be7a2fb0): created successfully Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97a8373-9450-49df-91d4-1b67cc83424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Flow 'volume_create_manager' (fdbed6b5-7958-4a0c-9d47-56f53cc0da97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:47:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b23c6f08-b19c-41ea-85f0-16126892c49c tempest-VolumesListTestJSON-648063332 None] Created volume successfully. Jun 27 04:47:49 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:47:49 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:49 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 0.744s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:49 devstack sudo[111344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:47:49 devstack sudo[111344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:50 devstack sudo[111344]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 1 in 0.771s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:47:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.556s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-834fa5c8-b1ee-475d-9981-9ece14db464b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4f4ec22-aa02-4003-8254-dcfb6086caf9', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:47:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-e19535f4-5e69-44de-881c-62819dad5e3b req-1a80c7fb-32a8-40e8-9fef-7d090c98391b tempest-TestShelveInstance-1767269831 None] attachment_update completed successfully. Jun 27 04:47:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "cinder-71689211-11ca-4416-9f1e-1298be7a2fb0-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-71689211-11ca-4416-9f1e-1298be7a2fb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "cinder-quobyte-71689211-11ca-4416-9f1e-1298be7a2fb0" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-quobyte-71689211-11ca-4416-9f1e-1298be7a2fb0" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73ab51-cc92-4e64-bb8c-55c7e37e02ac]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:51 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 Jun 27 04:47:51 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:52 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0" returned: 0 in 0.774s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:52 devstack sudo[111355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0 Jun 27 04:47:52 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:52 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-71689211-11ca-4416-9f1e-1298be7a2fb0" returned: 0 in 0.670s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-quobyte-71689211-11ca-4416-9f1e-1298be7a2fb0" released by "delete_volume" :: held 1.484s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Created reservations ['64522024-0506-43a1-9877-4d8c6a286ad0', '8d71c91f-d98e-4482-94d8-260435beb36f', 'bcfa98b6-9230-4471-879f-365691b785db', 'e389bdfd-a00d-4428-b791-e55232ee89c0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:53 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:53 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "cinder-702aab3b-3568-4e74-a412-0d2e17ba8fbf-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-702aab3b-3568-4e74-a412-0d2e17ba8fbf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:53 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.676s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Deleted volume successfully. Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "cinder-quobyte-702aab3b-3568-4e74-a412-0d2e17ba8fbf" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-0938ac40-6ae4-43b0-9ab2-addce57d6ed4 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-71689211-11ca-4416-9f1e-1298be7a2fb0-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-quobyte-702aab3b-3568-4e74-a412-0d2e17ba8fbf" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[588640ce-1911-41ff-ad47-ce0dfb539a62]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:53 devstack sudo[111361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf Jun 27 04:47:53 devstack sudo[111361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:54 devstack sudo[111361]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf" returned: 0 in 0.811s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:54 devstack sudo[111367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf Jun 27 04:47:54 devstack sudo[111367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:55 devstack sudo[111367]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-702aab3b-3568-4e74-a412-0d2e17ba8fbf" returned: 0 in 0.659s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-quobyte-702aab3b-3568-4e74-a412-0d2e17ba8fbf" released by "delete_volume" :: held 1.542s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Created reservations ['bf146c2f-1fac-4fcd-baad-f7727b75a22c', '541fd05b-a307-4b80-ad7c-ae9e86fa984c', '2261e1f6-3c3f-4b9a-9805-990a96513644', '803ca4df-ab00-4828-810b-0131fd9f049e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:55 devstack sudo[111370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:55 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Acquiring lock "cinder-000e90a9-4d23-4c5b-8885-4ce5beaa84d3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Lock "cinder-000e90a9-4d23-4c5b-8885-4ce5beaa84d3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Acquiring lock "cinder-quobyte-000e90a9-4d23-4c5b-8885-4ce5beaa84d3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Lock "cinder-quobyte-000e90a9-4d23-4c5b-8885-4ce5beaa84d3" acquired by "delete_volume" :: waited 0.015s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[47405e1d-34c8-42e8-85d1-d06e1a2d7adf]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:56 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.747s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Deleted volume successfully. Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fea8c319-b1ff-4dad-acc6-df2f674ce8d5 tempest-VolumesListTestJSON-648063332 None] Lock "cinder-702aab3b-3568-4e74-a412-0d2e17ba8fbf-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:56 devstack sudo[111373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 Jun 27 04:47:56 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:56 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3" returned: 0 in 0.817s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:56 devstack sudo[111379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3 Jun 27 04:47:56 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:57 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-000e90a9-4d23-4c5b-8885-4ce5beaa84d3" returned: 0 in 0.684s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Lock "cinder-quobyte-000e90a9-4d23-4c5b-8885-4ce5beaa84d3" released by "delete_volume" :: held 1.558s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Created reservations ['b0babc08-ca40-4dfc-9300-4f248b98a170', '3d6765c5-2369-4115-a9d3-c18d43cb409a', 'cf9f4577-a1ec-4543-a751-d6965bd036fa', '70db855d-aea4-40e5-8023-ec52268e1550'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:47:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:47:57 devstack sudo[111382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:47:57 devstack sudo[111382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:47:58 devstack sudo[111382]: pam_unix(sudo:session): session closed for user root Jun 27 04:47:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.728s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:47:58 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:47:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Deleted volume successfully. Jun 27 04:47:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bc4006cf-e590-4895-9951-05bb93f7763f tempest-VolumesListTestJSON-648063332 None] Lock "cinder-000e90a9-4d23-4c5b-8885-4ce5beaa84d3-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Flow 'volume_create_manager' (559a4ce6-117a-40db-b561-ada5f05f3123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0bd2ca-2a5b-427f-875e-78db9503150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0bd2ca-2a5b-427f-875e-78db9503150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-97778507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f48e6-7739-4279-9eb2-aa14ab090fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1aa18ba904284a8aceb6d5fca5b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:48:01Z,use_quota=True,user_id='1cc3ed923f364f7aa8053776cf9ccdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436d0c91-f3c7-4eae-a8df-39e175bdca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436d0c91-f3c7-4eae-a8df-39e175bdca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1bacf0-b9ab-44c0-9758-e245bb08b3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1bacf0-b9ab-44c0-9758-e245bb08b3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2f48e6-7739-4279-9eb2-aa14ab090fe5', 'volume_name': 'volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7b49c7-41cb-4590-bc8f-2ae5ce920244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7b49c7-41cb-4590-bc8f-2ae5ce920244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e860ec7-fef8-42db-86f9-fa993f705b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:48:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Volume de2f48e6-7739-4279-9eb2-aa14ab090fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5', 'volume_size': 1} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-97778507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f48e6-7739-4279-9eb2-aa14ab090fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1a1aa18ba904284a8aceb6d5fca5b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:48:01Z,use_quota=True,user_id='1cc3ed923f364f7aa8053776cf9ccdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Creating volume de2f48e6-7739-4279-9eb2-aa14ab090fe5 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:48:01 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:48:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:01 devstack sudo[111773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 1073741824 Jun 27 04:48:01 devstack sudo[111773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:02 devstack sudo[111773]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 1073741824" returned: 0 in 1.166s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:02 devstack sudo[111846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 Jun 27 04:48:02 devstack sudo[111846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:03 devstack sudo[111846]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5" returned: 0 in 0.794s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e860ec7-fef8-42db-86f9-fa993f705b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c84b2da-9ea5-41f6-82e2-7d7e6403e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:48:03 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Volume volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 (de2f48e6-7739-4279-9eb2-aa14ab090fe5): created successfully Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c84b2da-9ea5-41f6-82e2-7d7e6403e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:48:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Flow 'volume_create_manager' (559a4ce6-117a-40db-b561-ada5f05f3123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:48:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-96c20991-bd56-4a3a-b86e-6ba2b9353098 tempest-VolumesNegativeTest-1161260297 None] Created volume successfully. Jun 27 04:48:13 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:DELETE=1,cinder:SELECT=21,cinder:UPDATE=36,cinder:INSERT=8 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:48:13 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=29,cinder:SELECT=29,cinder:DELETE=5,cinder:INSERT=6 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:48:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:20 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:48:20 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:21 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.709s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:48:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Acquiring lock "cinder-de2f48e6-7739-4279-9eb2-aa14ab090fe5-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:48:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Lock "cinder-de2f48e6-7739-4279-9eb2-aa14ab090fe5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:48:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Acquiring lock "cinder-quobyte-de2f48e6-7739-4279-9eb2-aa14ab090fe5" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:48:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Lock "cinder-quobyte-de2f48e6-7739-4279-9eb2-aa14ab090fe5" acquired by "delete_volume" :: waited 0.013s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:48:34 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98fc419-66e5-407b-9d18-a48f4dfcc991]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:48:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:35 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 Jun 27 04:48:35 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:35 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5" returned: 0 in 0.749s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:35 devstack sudo[112106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5 Jun 27 04:48:35 devstack sudo[112106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:36 devstack sudo[112106]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-de2f48e6-7739-4279-9eb2-aa14ab090fe5" returned: 0 in 0.653s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Lock "cinder-quobyte-de2f48e6-7739-4279-9eb2-aa14ab090fe5" released by "delete_volume" :: held 1.452s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Created reservations ['24c59723-68ba-45e6-8ca5-7af10635fe43', 'c529501d-5d0a-4595-a2fd-1f72f8051c46', '7ac44de0-127a-4b86-b379-613d3eaad08c', '88ca528f-4cba-4398-95b5-3c93fcd96e1a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:48:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:36 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:48:36 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:37 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.658s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:37 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:48:37 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Deleted volume successfully. Jun 27 04:48:37 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9b9868a8-c642-41e5-baef-cd92ce5d3560 tempest-VolumesNegativeTest-1161260297 None] Lock "cinder-de2f48e6-7739-4279-9eb2-aa14ab090fe5-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:48:46 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-f34baf12-d039-4891-a13c-e65744b09897 req-5fe63faa-085f-4c70-93d3-30ad8c255912 tempest-TestShelveInstance-1767269831 None] Terminate volume connection completed successfully. Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-f34baf12-d039-4891-a13c-e65744b09897 req-5fe63faa-085f-4c70-93d3-30ad8c255912 tempest-TestShelveInstance-1767269831 None] Deleting attachment b4f4ec22-aa02-4003-8254-dcfb6086caf9. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Acquiring lock "cinder-834fa5c8-b1ee-475d-9981-9ece14db464b-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Lock "cinder-834fa5c8-b1ee-475d-9981-9ece14db464b-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Acquiring lock "cinder-quobyte-834fa5c8-b1ee-475d-9981-9ece14db464b" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Lock "cinder-quobyte-834fa5c8-b1ee-475d-9981-9ece14db464b" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de942d-b005-4eb3-8456-7f2a4ea8684d]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:48:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:46 devstack sudo[112165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:48:47 devstack sudo[112165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:47 devstack sudo[112165]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 0.974s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:47 devstack sudo[112169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:48:47 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:48 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 1 in 0.929s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:48:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:48 devstack sudo[112174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b Jun 27 04:48:48 devstack sudo[112174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:49 devstack sudo[112174]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-834fa5c8-b1ee-475d-9981-9ece14db464b" returned: 0 in 0.723s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Lock "cinder-quobyte-834fa5c8-b1ee-475d-9981-9ece14db464b" released by "delete_volume" :: held 2.709s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG cinder.quota [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Created reservations ['6a25a5a5-dffb-42b4-8764-2baaf5819a1a', 'd7067e65-8620-42a1-914c-35beeccd5396', '21aed740-7f2d-4f42-ad46-ce843996cec1', '391848e9-8964-424d-ad55-7dde6d534888'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:48:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:48:49 devstack sudo[112177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:48:49 devstack sudo[112177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:48:50 devstack sudo[112177]: pam_unix(sudo:session): session closed for user root Jun 27 04:48:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.757s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:48:50 devstack cinder-volume[93772]: DEBUG cinder.manager [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:48:50 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Deleted volume successfully. Jun 27 04:48:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [req-f34baf12-d039-4891-a13c-e65744b09897 req-ff93d993-e20c-47d2-85b2-72d5ea503c57 tempest-TestShelveInstance-1767269831 None] Lock "cinder-834fa5c8-b1ee-475d-9981-9ece14db464b-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:48:59 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:49:00 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Flow 'volume_create_manager' (f226b650-5271-4164-a991-db8ade618f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12abcd76-0a48-485d-91ee-b34dd402ad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12abcd76-0a48-485d-91ee-b34dd402ad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1970284402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf10a078-109e-45d4-997b-ffd57dad5aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed7540009b34733b3f4d2f770b62180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:05Z,use_quota=True,user_id='d72ba8c66a704e14b3bb58b0f675d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c74c29e7-0e6e-45b1-9d46-d98720a03660),volume_type_id=c74c29e7-0e6e-45b1-9d46-d98720a03660)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9660d1e2-d525-4fc0-a705-581760dd1e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9660d1e2-d525-4fc0-a705-581760dd1e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a5e9ea-c1c9-4dbf-8860-23c0cfcd3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a5e9ea-c1c9-4dbf-8860-23c0cfcd3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf10a078-109e-45d4-997b-ffd57dad5aa3', 'volume_name': 'volume-bf10a078-109e-45d4-997b-ffd57dad5aa3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cc91b4-617e-46cb-a982-e0576022f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cc91b4-617e-46cb-a982-e0576022f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc4eddf-675c-4eba-9f03-39c402d6ad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Volume bf10a078-109e-45d4-997b-ffd57dad5aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf10a078-109e-45d4-997b-ffd57dad5aa3', 'volume_size': 1} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1970284402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf10a078-109e-45d4-997b-ffd57dad5aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed7540009b34733b3f4d2f770b62180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:05Z,use_quota=True,user_id='d72ba8c66a704e14b3bb58b0f675d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c74c29e7-0e6e-45b1-9d46-d98720a03660),volume_type_id=c74c29e7-0e6e-45b1-9d46-d98720a03660)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Creating volume bf10a078-109e-45d4-997b-ffd57dad5aa3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:49:05 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:05 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 1073741824 Jun 27 04:49:05 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Flow 'volume_create_manager' (d5a48d54-be6b-4e95-acb3-eeb47c9dde7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b50860a-973f-458d-9f2c-f04a728824e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b50860a-973f-458d-9f2c-f04a728824e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-337986325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43354fda-176b-4655-996e-115886935e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed7540009b34733b3f4d2f770b62180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:06Z,use_quota=True,user_id='d72ba8c66a704e14b3bb58b0f675d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60350a0-deb0-44b8-88a5-1574f0df5111),volume_type_id=f60350a0-deb0-44b8-88a5-1574f0df5111)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31113d08-ec44-4bdb-9286-c195b014f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31113d08-ec44-4bdb-9286-c195b014f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22f0608-7059-4d9e-86d1-bb1edb082a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22f0608-7059-4d9e-86d1-bb1edb082a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43354fda-176b-4655-996e-115886935e76', 'volume_name': 'volume-43354fda-176b-4655-996e-115886935e76', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca055345-4636-433d-92a3-991f9c87f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca055345-4636-433d-92a3-991f9c87f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2141eb-e5b1-4851-9b60-f6184e8bfc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Volume 43354fda-176b-4655-996e-115886935e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43354fda-176b-4655-996e-115886935e76', 'volume_size': 1} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Flow 'volume_create_manager' (fe69c968-11f5-4d70-96ee-f971f0711af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcc1035-f408-404f-9a02-3666c21b3fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcc1035-f408-404f-9a02-3666c21b3fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292725068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456bce9e-470b-4a89-9995-6654d3223d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed7540009b34733b3f4d2f770b62180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:07Z,use_quota=True,user_id='d72ba8c66a704e14b3bb58b0f675d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b19e3c92-e874-4305-8c35-281da0aca2ea),volume_type_id=b19e3c92-e874-4305-8c35-281da0aca2ea)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e060916-7b72-4700-a07a-b4d9dea74d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e060916-7b72-4700-a07a-b4d9dea74d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534cd9fa-8a7a-450c-b3e2-a2058a25b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:49:06 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 1073741824" returned: 0 in 1.055s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:06 devstack sudo[112195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 Jun 27 04:49:06 devstack sudo[112195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534cd9fa-8a7a-450c-b3e2-a2058a25b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '456bce9e-470b-4a89-9995-6654d3223d8d', 'volume_name': 'volume-456bce9e-470b-4a89-9995-6654d3223d8d', 'volume_size': 1, 'image_id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71f33e77-792b-4237-a7c3-2af7f1bc3522', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1644308958', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ed7540009b34733b3f4d2f770b62180', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'created_at': datetime.datetime(2026, 6, 27, 2, 49, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71f33e77-792b-4237-a7c3-2af7f1bc3522/file', 'properties': {}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99e4999-7586-4d5d-99fc-7cd512e1af11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99e4999-7586-4d5d-99fc-7cd512e1af11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfa5489-cb6b-4432-bd33-128ce1ce7274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:06 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Volume 456bce9e-470b-4a89-9995-6654d3223d8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-456bce9e-470b-4a89-9995-6654d3223d8d', 'volume_size': 1, 'image_id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71f33e77-792b-4237-a7c3-2af7f1bc3522', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1644308958', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ed7540009b34733b3f4d2f770b62180', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'created_at': datetime.datetime(2026, 6, 27, 2, 49, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71f33e77-792b-4237-a7c3-2af7f1bc3522/file', 'properties': {}}, 'image_service': } Jun 27 04:49:06 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Trying to clone 456bce9e-470b-4a89-9995-6654d3223d8d from image 71f33e77-792b-4237-a7c3-2af7f1bc3522 at location (None, [{'url': 'file:///opt/stack/data/glance/images/71f33e77-792b-4237-a7c3-2af7f1bc3522', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:49:07 devstack sudo[112195]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3" returned: 0 in 0.701s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.432s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-337986325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43354fda-176b-4655-996e-115886935e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed7540009b34733b3f4d2f770b62180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:06Z,use_quota=True,user_id='d72ba8c66a704e14b3bb58b0f675d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f60350a0-deb0-44b8-88a5-1574f0df5111),volume_type_id=f60350a0-deb0-44b8-88a5-1574f0df5111)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Creating volume 43354fda-176b-4655-996e-115886935e76 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:49:07 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc4eddf-675c-4eba-9f03-39c402d6ad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf10a078-109e-45d4-997b-ffd57dad5aa3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:07 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 1073741824 Jun 27 04:49:07 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01afec0d-1b5e-4539-babf-a1968ae2f5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:07 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Volume volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 (bf10a078-109e-45d4-997b-ffd57dad5aa3): created successfully Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01afec0d-1b5e-4539-babf-a1968ae2f5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Flow 'volume_create_manager' (f226b650-5271-4164-a991-db8ade618f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-63abbfee-2e32-4f3c-9702-69f0b0c081d2 tempest-TestInstancesWithCinderVolumes-610515065 None] Created volume successfully. Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Flow 'volume_create_manager' (264970e0-4ef8-4c66-a783-cca98ec27b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d38e43-c36e-4a11-8914-b6feb72f778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d38e43-c36e-4a11-8914-b6feb72f778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f82404-ea1a-4be2-b576-47f69c11d13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ccf08a9ac1486eb2cc959235f0e776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:08Z,use_quota=True,user_id='a98bf70fdd764f228b85c8963e20e150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76eaaabd-8b2d-49e1-a1a3-a8b4cb63bf6d),volume_type_id=76eaaabd-8b2d-49e1-a1a3-a8b4cb63bf6d)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e174ae5-9ff3-4f3d-8974-83f1b53d6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e174ae5-9ff3-4f3d-8974-83f1b53d6e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6431cfd5-1fa6-468a-8159-301e680343d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:07 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6431cfd5-1fa6-468a-8159-301e680343d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1f82404-ea1a-4be2-b576-47f69c11d13e', 'volume_name': 'volume-b1f82404-ea1a-4be2-b576-47f69c11d13e', 'volume_size': 1, 'image_id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c82223f-4ec9-48c4-9701-1c417296340f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ec6917dc62548a649a1833877fa57e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73ccf08a9ac1486eb2cc959235f0e776', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d3dfe4093e95fc6c9e01ab5ffe3a9693de84fd6758fa9ebb5bf98623f5f379d8c7f5fddbdd32fdc7191bc297f4a6b847d6e0230e544f371ca37e6ab8dbe52c2', 'id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'created_at': datetime.datetime(2026, 6, 27, 2, 49, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 49, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c82223f-4ec9-48c4-9701-1c417296340f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90762f6-cadf-4af2-8499-33474b66f975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90762f6-cadf-4af2-8499-33474b66f975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d68893-58d2-462f-9777-95f9adf08bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:08 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Volume b1f82404-ea1a-4be2-b576-47f69c11d13e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1f82404-ea1a-4be2-b576-47f69c11d13e', 'volume_size': 1, 'image_id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c82223f-4ec9-48c4-9701-1c417296340f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ec6917dc62548a649a1833877fa57e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73ccf08a9ac1486eb2cc959235f0e776', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d3dfe4093e95fc6c9e01ab5ffe3a9693de84fd6758fa9ebb5bf98623f5f379d8c7f5fddbdd32fdc7191bc297f4a6b847d6e0230e544f371ca37e6ab8dbe52c2', 'id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'created_at': datetime.datetime(2026, 6, 27, 2, 49, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 49, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c82223f-4ec9-48c4-9701-1c417296340f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Trying to clone b1f82404-ea1a-4be2-b576-47f69c11d13e from image 9c82223f-4ec9-48c4-9701-1c417296340f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c82223f-4ec9-48c4-9701-1c417296340f', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:49:08 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Image download 0.00 MB at 0.00 MB/s Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1181f745-e34f-4e97-9e57-e80cc2a70ebc]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:08 devstack sudo[112204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD Jun 27 04:49:08 devstack sudo[112204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:08 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 1073741824" returned: 0 in 0.916s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:08 devstack sudo[112206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 Jun 27 04:49:08 devstack sudo[112206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:08 devstack sudo[112204]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:09 devstack sudo[112210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD Jun 27 04:49:09 devstack sudo[112210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:09 devstack sudo[112206]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2141eb-e5b1-4851-9b60-f6184e8bfc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43354fda-176b-4655-996e-115886935e76', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a526dfb1-1fde-4012-9283-1331f2ef7e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Volume volume-43354fda-176b-4655-996e-115886935e76 (43354fda-176b-4655-996e-115886935e76): created successfully Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a526dfb1-1fde-4012-9283-1331f2ef7e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Flow 'volume_create_manager' (d5a48d54-be6b-4e95-acb3-eeb47c9dde7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7b555c07-44f6-404e-a2a7-d56d15c9a6e2 tempest-TestInstancesWithCinderVolumes-610515065 None] Created volume successfully. Jun 27 04:49:09 devstack sudo[112210]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD" returned: 1 in 0.774s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Temporary image 9c82223f-4ec9-48c4-9701-1c417296340f is fetched for user a98bf70fdd764f228b85c8963e20e150. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[265fce33-cbd7-411a-826e-bde887781fad]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:09 devstack sudo[112217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD Jun 27 04:49:09 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:10 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:10 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD, size 20.69 MB, duration 3.60 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:49:10 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Image download 20.69 MB at 5.75 MB/s Jun 27 04:49:10 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2408833f-93c5-4b66-8de6-93f945a59245]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:10 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD Jun 27 04:49:10 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:10 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD Jun 27 04:49:10 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:11 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f82404-ea1a-4be2-b576-47f69c11d13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ccf08a9ac1486eb2cc959235f0e776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:08Z,use_quota=True,user_id='a98bf70fdd764f228b85c8963e20e150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76eaaabd-8b2d-49e1-a1a3-a8b4cb63bf6d),volume_type_id=76eaaabd-8b2d-49e1-a1a3-a8b4cb63bf6d)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Creating volume b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:49:11 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:11 devstack sudo[112231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e 1073741824 Jun 27 04:49:11 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:11 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Temporary image 71f33e77-792b-4237-a7c3-2af7f1bc3522 is fetched for user d72ba8c66a704e14b3bb58b0f675d3c5. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5991e-b642-4f45-8c57-9b46d0a0d5e6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:11 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD Jun 27 04:49:11 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:12 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e 1073741824" returned: 0 in 0.847s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:12 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:12 devstack sudo[112242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:12 devstack sudo[112242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:12 devstack sudo[112242]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 0 in 0.672s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292725068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456bce9e-470b-4a89-9995-6654d3223d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed7540009b34733b3f4d2f770b62180',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:49:07Z,use_quota=True,user_id='d72ba8c66a704e14b3bb58b0f675d3c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b19e3c92-e874-4305-8c35-281da0aca2ea),volume_type_id=b19e3c92-e874-4305-8c35-281da0aca2ea)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Creating volume 456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:49:12 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:12 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d 1073741824 Jun 27 04:49:12 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Attempting download of 9c82223f-4ec9-48c4-9701-1c417296340f ((None, [{'url': 'file:///opt/stack/data/glance/images/9c82223f-4ec9-48c4-9701-1c417296340f', 'metadata': {}}])) to volume b1f82404-ea1a-4be2-b576-47f69c11d13e. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cadcb0-8472-47f8-a9f9-956adfc89db3]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:13 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo Jun 27 04:49:13 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:13 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d 1073741824" returned: 0 in 0.818s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:13 devstack sudo[112254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:49:13 devstack sudo[112254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:13 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo" returned: 0 in 0.798s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:13 devstack sudo[112256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo Jun 27 04:49:13 devstack sudo[112256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:14 devstack sudo[112254]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 0 in 0.643s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Attempting download of 71f33e77-792b-4237-a7c3-2af7f1bc3522 ((None, [{'url': 'file:///opt/stack/data/glance/images/71f33e77-792b-4237-a7c3-2af7f1bc3522', 'metadata': {}}])) to volume 456bce9e-470b-4a89-9995-6654d3223d8d. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407a328-1223-4e35-8fe4-d26744a6d704]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:14 devstack sudo[112256]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo" returned: 1 in 0.788s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c82223f-4ec9-48c4-9701-1c417296340f_k15dm0lo' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab018df4-883d-45db-b802-4b275bc63f18]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:14 devstack sudo[112262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h Jun 27 04:49:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:14 devstack sudo[112262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:14 devstack sudo[112264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD Jun 27 04:49:14 devstack sudo[112264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:15 devstack sudo[112262]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h" returned: 0 in 0.787s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:15 devstack sudo[112264]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:15 devstack sudo[112270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h Jun 27 04:49:15 devstack sudo[112270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:15 devstack sudo[112271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD Jun 27 04:49:15 devstack sudo[112271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:15 devstack sudo[112270]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h" returned: 1 in 0.788s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_71f33e77-792b-4237-a7c3-2af7f1bc3522_5uvi4b2h' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abf9d5-0a9f-497f-9b58-a8d59a671aca]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:16 devstack sudo[112271]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD" returned: 1 in 0.778s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] 9c82223f-4ec9-48c4-9701-1c417296340f was raw, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:16 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:16 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:16 devstack sudo[112279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD Jun 27 04:49:16 devstack sudo[112279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:16 devstack sudo[112279]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] 71f33e77-792b-4237-a7c3-2af7f1bc3522 was qcow2, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:16 devstack sudo[112325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:49:16 devstack sudo[112325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:16 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 0 in 0.779s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c82223f-4ec9-48c4-9701-1c417296340f_adrikdvidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:49:16 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 04:49:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:16 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e 1G Jun 27 04:49:16 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:17 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e 1G" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[01da980f-98c2-41b5-946a-bfd6b4d3850a]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:17 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:17 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:18 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 0 in 0.867s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:18 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:18 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:18 devstack sudo[112325]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 0 in 1.951s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:18 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_71f33e77-792b-4237-a7c3-2af7f1bc3522_cz6hxpnvdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:49:18 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Converted 112.00 MB image at 57.38 MB/s Jun 27 04:49:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:18 devstack sudo[112344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d 1G Jun 27 04:49:18 devstack sudo[112344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:19 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 1 in 0.792s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Downloaded image 9c82223f-4ec9-48c4-9701-1c417296340f ((None, [{'url': 'file:///opt/stack/data/glance/images/9c82223f-4ec9-48c4-9701-1c417296340f', 'metadata': {}}])) to volume b1f82404-ea1a-4be2-b576-47f69c11d13e successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Temporary image 9c82223f-4ec9-48c4-9701-1c417296340f for user a98bf70fdd764f228b85c8963e20e150 is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Marking volume b1f82404-ea1a-4be2-b576-47f69c11d13e as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Copying metadata from image 9c82223f-4ec9-48c4-9701-1c417296340f to b1f82404-ea1a-4be2-b576-47f69c11d13e. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Creating volume glance metadata for volume b1f82404-ea1a-4be2-b576-47f69c11d13e backed by image 9c82223f-4ec9-48c4-9701-1c417296340f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4ec6917dc62548a649a1833877fa57e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d68893-58d2-462f-9777-95f9adf08bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f82404-ea1a-4be2-b576-47f69c11d13e', 'volume_size': 1, 'image_id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c82223f-4ec9-48c4-9701-1c417296340f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ec6917dc62548a649a1833877fa57e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73ccf08a9ac1486eb2cc959235f0e776', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d3dfe4093e95fc6c9e01ab5ffe3a9693de84fd6758fa9ebb5bf98623f5f379d8c7f5fddbdd32fdc7191bc297f4a6b847d6e0230e544f371ca37e6ab8dbe52c2', 'id': '9c82223f-4ec9-48c4-9701-1c417296340f', 'created_at': datetime.datetime(2026, 6, 27, 2, 49, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 49, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c82223f-4ec9-48c4-9701-1c417296340f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5241cf-8192-45e7-8581-5841281afd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:19 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Volume volume-b1f82404-ea1a-4be2-b576-47f69c11d13e (b1f82404-ea1a-4be2-b576-47f69c11d13e): created successfully Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5241cf-8192-45e7-8581-5841281afd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Flow 'volume_create_manager' (264970e0-4ef8-4c66-a783-cca98ec27b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:19 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e6cbb381-0599-41ef-9c55-8d0eb9f82c65 tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Created volume successfully. Jun 27 04:49:19 devstack sudo[112344]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d 1G" returned: 0 in 0.708s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa72c9e-dcd9-436a-87e8-472f61c5588a]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:19 devstack sudo[112358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:49:19 devstack sudo[112358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:20 devstack sudo[112358]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 0 in 0.729s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:20 devstack sudo[112362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:49:20 devstack sudo[112362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Acquiring lock "cinder-b1f82404-ea1a-4be2-b576-47f69c11d13e-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "cinder-b1f82404-ea1a-4be2-b576-47f69c11d13e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Acquiring lock "cinder-quobyte-b1f82404-ea1a-4be2-b576-47f69c11d13e" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "cinder-quobyte-b1f82404-ea1a-4be2-b576-47f69c11d13e" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[95946a6d-4ef6-495b-b870-c48f87d9d6ae]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:20 devstack sudo[112365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:49:20 devstack sudo[112365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:20 devstack sudo[112364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:20 devstack sudo[112364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:20 devstack sudo[112362]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 1 in 0.773s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Downloaded image 71f33e77-792b-4237-a7c3-2af7f1bc3522 ((None, [{'url': 'file:///opt/stack/data/glance/images/71f33e77-792b-4237-a7c3-2af7f1bc3522', 'metadata': {}}])) to volume 456bce9e-470b-4a89-9995-6654d3223d8d successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Temporary image 71f33e77-792b-4237-a7c3-2af7f1bc3522 for user d72ba8c66a704e14b3bb58b0f675d3c5 is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Marking volume 456bce9e-470b-4a89-9995-6654d3223d8d as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Copying metadata from image 71f33e77-792b-4237-a7c3-2af7f1bc3522 to 456bce9e-470b-4a89-9995-6654d3223d8d. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:49:20 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Creating volume glance metadata for volume 456bce9e-470b-4a89-9995-6654d3223d8d backed by image 71f33e77-792b-4237-a7c3-2af7f1bc3522 with: {'image_id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'image_name': 'tempest-scenario-img--1644308958', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfa5489-cb6b-4432-bd33-128ce1ce7274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456bce9e-470b-4a89-9995-6654d3223d8d', 'volume_size': 1, 'image_id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/71f33e77-792b-4237-a7c3-2af7f1bc3522', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1644308958', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ed7540009b34733b3f4d2f770b62180', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '71f33e77-792b-4237-a7c3-2af7f1bc3522', 'created_at': datetime.datetime(2026, 6, 27, 2, 49, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 49, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/71f33e77-792b-4237-a7c3-2af7f1bc3522/file', 'properties': {}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66c7301-bd9c-4ccf-869f-bb2228ccaa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:49:21 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Volume volume-456bce9e-470b-4a89-9995-6654d3223d8d (456bce9e-470b-4a89-9995-6654d3223d8d): created successfully Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66c7301-bd9c-4ccf-869f-bb2228ccaa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Flow 'volume_create_manager' (fe69c968-11f5-4d70-96ee-f971f0711af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:49:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f125c472-3a70-448b-85dd-b71e53cb048c tempest-TestInstancesWithCinderVolumes-610515065 None] Created volume successfully. Jun 27 04:49:21 devstack sudo[112365]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.678s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:49:21 devstack sudo[112364]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 0 in 0.886s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:21 devstack sudo[112374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:21 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:22 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 1 in 0.818s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:22 devstack sudo[112380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e Jun 27 04:49:22 devstack sudo[112380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:22 devstack sudo[112380]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b1f82404-ea1a-4be2-b576-47f69c11d13e" returned: 0 in 0.713s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "cinder-quobyte-b1f82404-ea1a-4be2-b576-47f69c11d13e" released by "delete_volume" :: held 2.480s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:49:23 devstack cinder-volume[93772]: WARNING cinder.quota [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:49:23 devstack cinder-volume[93772]: WARNING cinder.quota [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Created reservations ['b4996bc2-dcfb-4117-a9c5-3d5d3947c59a', 'ed0b2535-5827-44c6-93cc-5b8ec2cd2bdf', '7184474b-536d-4ba6-a354-8e5cf5107924', 'a99582fc-dbc9-4d22-964f-be2502be9b43'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:23 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:49:23 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:23 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.750s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:49:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Deleted volume successfully. Jun 27 04:49:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-68cfb2c4-6a46-4a06-855e-df2d65b640ba tempest-VolumeAndVolumeTypeFromImageTest-1924410384 None] Lock "cinder-b1f82404-ea1a-4be2-b576-47f69c11d13e-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:49:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:49:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:49:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[917e2c56-0240-4cfb-9056-2a7f4f6141b0]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:49:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:28 devstack sudo[112398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:49:28 devstack sudo[112398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:29 devstack sudo[112398]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 0 in 0.836s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:49:29 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:49:29 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:49:30 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Jun 27 04:49:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 1 in 0.855s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:49:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:49:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.733s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:49:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-456bce9e-470b-4a89-9995-6654d3223d8d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e2ce26c-1858-4fbb-a05d-29e7751d7021', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:49:30 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-28ca6843-cbd6-45b1-8896-8f40cae494c8 req-4f1b1dd3-a48f-4efd-8e13-2add0af0c02f tempest-TestInstancesWithCinderVolumes-610515065 None] attachment_update completed successfully. Jun 27 04:49:40 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:49:40 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:DELETE=1,cinder:INSERT=11 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:50:02 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:50:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[889b97fb-5701-4af8-b1be-3abc1d26b5ad]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:50:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:07 devstack sudo[113005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 Jun 27 04:50:07 devstack sudo[113005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:08 devstack sudo[113005]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3" returned: 0 in 0.752s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-bf10a078-109e-45d4-997b-ffd57dad5aa3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4984f6a8-8d63-4067-9a47-2dd8d3066b83', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:50:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-bea5c0b9-27d2-401c-ab0e-d228b7fba333 req-5e4c06b5-7ed2-4420-bff0-718b4708b381 tempest-TestInstancesWithCinderVolumes-610515065 None] attachment_update completed successfully. Jun 27 04:50:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:15 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de1fc58-4811-4a22-bc49-1c7b9b644fd2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:50:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:15 devstack sudo[113034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 Jun 27 04:50:15 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:16 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76" returned: 0 in 0.849s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350', 'name': 'volume-43354fda-176b-4655-996e-115886935e76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89ed8c89-af7d-4f2e-a5f0-8882f851aaa0', 'enforce_multipath': True} {{(pid=93772) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 27 04:50:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-17dec88b-8289-418b-bac7-4b1728c6f034 req-3a9ac62c-177d-4579-9a32-2fb114b14a05 tempest-TestInstancesWithCinderVolumes-610515065 None] attachment_update completed successfully. Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:20 devstack sudo[113088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:50:20 devstack sudo[113088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:21 devstack sudo[113088]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.714s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:50:25 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-c5b7cf79-3f86-497a-8f23-025af490ae05 req-8f07244f-1601-4937-b215-ae8487daf3b2 tempest-TestInstancesWithCinderVolumes-610515065 None] Terminate volume connection completed successfully. Jun 27 04:50:25 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-c5b7cf79-3f86-497a-8f23-025af490ae05 req-8f07244f-1601-4937-b215-ae8487daf3b2 tempest-TestInstancesWithCinderVolumes-610515065 None] Deleting attachment 4984f6a8-8d63-4067-9a47-2dd8d3066b83. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:50:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "cinder-bf10a078-109e-45d4-997b-ffd57dad5aa3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:50:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-bf10a078-109e-45d4-997b-ffd57dad5aa3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:50:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "cinder-quobyte-bf10a078-109e-45d4-997b-ffd57dad5aa3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:50:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-quobyte-bf10a078-109e-45d4-997b-ffd57dad5aa3" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:50:27 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924a3d7-fb1a-40e6-b9a9-2cbd1a457e84]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:50:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:27 devstack sudo[113129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 Jun 27 04:50:27 devstack sudo[113129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:28 devstack sudo[113129]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:28 devstack sudo[113136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3 Jun 27 04:50:28 devstack sudo[113136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:29 devstack sudo[113136]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-bf10a078-109e-45d4-997b-ffd57dad5aa3" returned: 0 in 0.734s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-quobyte-bf10a078-109e-45d4-997b-ffd57dad5aa3" released by "delete_volume" :: held 1.592s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:50:29 devstack cinder-volume[93772]: WARNING cinder.quota [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43436430-875072098 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43436430-875072098, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:50:29 devstack cinder-volume[93772]: WARNING cinder.quota [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43436430-875072098 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43436430-875072098, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Created reservations ['87cd0317-88a7-47d3-abd8-bd578dba7cd0', '55f7c213-70f8-4ba8-b4cb-8dcaeb830871', '6536f8e2-9bd7-4cea-977e-393008d90e43', '96286c37-2d03-4677-84e0-2f26aa009a42'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:29 devstack sudo[113139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:50:29 devstack sudo[113139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:29 devstack sudo[113139]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.681s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:50:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Deleted volume successfully. Jun 27 04:50:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-c2f59a5f-f5c9-48d6-9435-76588cc59193 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-bf10a078-109e-45d4-997b-ffd57dad5aa3-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:50:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-9e378ea5-b537-4cd9-8259-69baf5380abe req-e069e699-c698-4633-9ed2-195539cbf95f tempest-TestInstancesWithCinderVolumes-610515065 None] Terminate volume connection completed successfully. Jun 27 04:50:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-9e378ea5-b537-4cd9-8259-69baf5380abe req-e069e699-c698-4633-9ed2-195539cbf95f tempest-TestInstancesWithCinderVolumes-610515065 None] Deleting attachment 89ed8c89-af7d-4f2e-a5f0-8882f851aaa0. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "cinder-43354fda-176b-4655-996e-115886935e76-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-43354fda-176b-4655-996e-115886935e76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "cinder-quobyte-43354fda-176b-4655-996e-115886935e76" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-quobyte-43354fda-176b-4655-996e-115886935e76" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a4439-e913-4d86-be7a-0bc4f7f9640c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:34 devstack sudo[113172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 Jun 27 04:50:34 devstack sudo[113172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:34 devstack sudo[113172]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76" returned: 0 in 0.839s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:34 devstack sudo[113178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76 Jun 27 04:50:34 devstack sudo[113178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:35 devstack sudo[113178]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-43354fda-176b-4655-996e-115886935e76" returned: 0 in 0.774s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-quobyte-43354fda-176b-4655-996e-115886935e76" released by "delete_volume" :: held 1.668s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:50:35 devstack cinder-volume[93772]: WARNING cinder.quota [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1164173292-1805995502 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1164173292-1805995502, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:50:35 devstack cinder-volume[93772]: WARNING cinder.quota [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1164173292-1805995502 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1164173292-1805995502, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Created reservations ['80a5b0fb-d032-4d74-b066-c9d15fca3e18', '3844cdac-900d-40e3-825e-b43dcbdfacac', '437b2cdb-309b-458d-90d7-a3d729ede81e', '0c46c82c-883a-4e31-ac44-4d857b7a6cb4'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:35 devstack sudo[113182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:50:35 devstack sudo[113182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:36 devstack sudo[113182]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.715s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:36 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:50:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Deleted volume successfully. Jun 27 04:50:36 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-300eff84-b8b7-4c99-8520-528f4241e5bb tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-43354fda-176b-4655-996e-115886935e76-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:50:40 devstack cinder-volume[93772]: INFO cinder.volume.manager [req-0c0166b1-3d17-41a4-b05e-0c8e9493e8cc req-bee80eaf-3b0b-4eb9-a75c-f1cd64f99951 tempest-TestInstancesWithCinderVolumes-610515065 None] Terminate volume connection completed successfully. Jun 27 04:50:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [req-0c0166b1-3d17-41a4-b05e-0c8e9493e8cc req-bee80eaf-3b0b-4eb9-a75c-f1cd64f99951 tempest-TestInstancesWithCinderVolumes-610515065 None] Deleting attachment 1e2ce26c-1858-4fbb-a05d-29e7751d7021. {{(pid=93772) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 27 04:50:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "cinder-456bce9e-470b-4a89-9995-6654d3223d8d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:50:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-456bce9e-470b-4a89-9995-6654d3223d8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:50:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "cinder-quobyte-456bce9e-470b-4a89-9995-6654d3223d8d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:50:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-quobyte-456bce9e-470b-4a89-9995-6654d3223d8d" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:50:44 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c773954-3206-49a7-acb8-1bc4b3beab87]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:50:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:44 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:50:44 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:45 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 0 in 0.750s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:45 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:50:45 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:46 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 1 in 0.795s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:46 devstack sudo[113240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d Jun 27 04:50:46 devstack sudo[113240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:46 devstack sudo[113240]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-456bce9e-470b-4a89-9995-6654d3223d8d" returned: 0 in 0.733s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-quobyte-456bce9e-470b-4a89-9995-6654d3223d8d" released by "delete_volume" :: held 2.345s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:50:46 devstack cinder-volume[93772]: WARNING cinder.quota [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869891785-192946214 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869891785-192946214, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:50:46 devstack cinder-volume[93772]: WARNING cinder.quota [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869891785-192946214 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-869891785-192946214, it is now deprecated. Please use the default quota class for default quota. Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Created reservations ['836a3374-d76c-4c5f-a3f9-86ef52eb6e88', '2313e3ce-de48-4612-aeb0-4f7d7c704562', '35c4e22e-c839-4d0f-9323-ec1b8e0e64ab', 'e92928ac-b2ba-4970-9def-776986c27c7c'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:46 devstack sudo[113243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:50:46 devstack sudo[113243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:50:47 devstack sudo[113243]: pam_unix(sudo:session): session closed for user root Jun 27 04:50:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.715s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:50:47 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:50:47 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Deleted volume successfully. Jun 27 04:50:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d2cd40d0-eaa7-4888-961b-1de04b2196c0 tempest-TestInstancesWithCinderVolumes-610515065 None] Lock "cinder-456bce9e-470b-4a89-9995-6654d3223d8d-delete_volume" released by "delete_volume" :: held 3.301s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:50:56 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:INSERT=5 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:50:57 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=31,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=3 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (cec5621d-6d30-4480-b1f3-6b0aec793bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea016bf6-b274-4e71-8d57-b1cb4cd6cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea016bf6-b274-4e71-8d57-b1cb4cd6cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645868380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c11d1a-4bd2-433f-83f2-b4c59bb7be0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:50:59Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea822cb6-1dcf-415e-b80a-0f4eb39c3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea822cb6-1dcf-415e-b80a-0f4eb39c3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91d337a-5dea-4fbb-bde3-d00ab6362a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91d337a-5dea-4fbb-bde3-d00ab6362a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c11d1a-4bd2-433f-83f2-b4c59bb7be0c', 'volume_name': 'volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05a28ce-689b-4de4-b572-b874f001895b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05a28ce-689b-4de4-b572-b874f001895b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3456e3aa-e5d3-41f8-8b38-5cffe7695688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:50:59 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume 92c11d1a-4bd2-433f-83f2-b4c59bb7be0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c', 'volume_size': 1} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-645868380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c11d1a-4bd2-433f-83f2-b4c59bb7be0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:50:59Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating volume 92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:50:59 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:50:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:50:59 devstack sudo[113251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c 1073741824 Jun 27 04:50:59 devstack sudo[113251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:00 devstack sudo[113251]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c 1073741824" returned: 0 in 0.864s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:00 devstack sudo[113256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c Jun 27 04:51:00 devstack sudo[113256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:01 devstack sudo[113256]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" returned: 0 in 0.656s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3456e3aa-e5d3-41f8-8b38-5cffe7695688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe346ea-ac7a-4101-b796-145d70638b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c (92c11d1a-4bd2-433f-83f2-b4c59bb7be0c): created successfully Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe346ea-ac7a-4101-b796-145d70638b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (cec5621d-6d30-4480-b1f3-6b0aec793bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:01 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-6e161242-d0f8-4382-843d-98473b11de66 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created volume successfully. Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating offline snapshot f1a2dcf7-b604-4e17-9c74-cd7380f6cbda of volume 92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb875b48-0697-4de1-9b88-ad31bbd2c6fb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:01 devstack sudo[113259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c Jun 27 04:51:01 devstack sudo[113259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:02 devstack sudo[113259]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" returned: 0 in 0.852s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:02 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda 1G Jun 27 04:51:02 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:03 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda 1G" returned: 0 in 0.876s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:03 devstack sudo[113270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda Jun 27 04:51:03 devstack sudo[113270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:04 devstack sudo[113270]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:04 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda is being set with open permissions: ugo+rw Jun 27 04:51:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:04 devstack sudo[113276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda Jun 27 04:51:04 devstack sudo[113276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:04 devstack sudo[113276]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" returned: 0 in 0.688s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:04 devstack sudo[113281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info Jun 27 04:51:04 devstack sudo[113281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:05 devstack sudo[113281]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info" returned: 0 in 0.728s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:05 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info is being set with open permissions: ugo+rw Jun 27 04:51:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:05 devstack sudo[113284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info Jun 27 04:51:05 devstack sudo[113284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:06 devstack sudo[113284]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.info" returned: 0 in 0.729s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.680s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:06 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cc6cf43e-a5d8-4d0c-a77a-479808d94a4d tempest-CreateVolumesFromSnapshotTest-798434801 None] Create snapshot completed successfully Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (60518599-829f-45a0-9623-4016c271b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e132bae7-91f5-43b8-bee5-b5a006a8421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e132bae7-91f5-43b8-bee5-b5a006a8421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193186816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d138d62-6c81-4e0a-a9f9-2de57000a08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:08Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8333006-ef21-4536-8c90-244d4c630e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8333006-ef21-4536-8c90-244d4c630e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170f7ed5-3e56-4620-8e8d-ae9248bda660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170f7ed5-3e56-4620-8e8d-ae9248bda660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d138d62-6c81-4e0a-a9f9-2de57000a08d', 'volume_name': 'volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65347346-76d3-4313-b4e5-0413bc14e4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65347346-76d3-4313-b4e5-0413bc14e4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f85298-3382-4e9c-88f2-e07e42e1c4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:07 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume 4d138d62-6c81-4e0a-a9f9-2de57000a08d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d', 'volume_size': 1} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193186816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d138d62-6c81-4e0a-a9f9-2de57000a08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:08Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating volume 4d138d62-6c81-4e0a-a9f9-2de57000a08d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:07 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:07 devstack sudo[113287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d 1073741824 Jun 27 04:51:07 devstack sudo[113287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (ae3d51e2-c169-4829-ada8-b8f8920aec35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4da154-9d98-4438-b941-1874c6201b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4da154-9d98-4438-b941-1874c6201b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-797428251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370893a4-bcfe-4248-a6ee-6febaa7d1bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:08Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efc27b7-fc61-4f3a-85f1-5b7c7884f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efc27b7-fc61-4f3a-85f1-5b7c7884f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f958a00-bbdd-4688-99ba-03ad0b85165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f958a00-bbdd-4688-99ba-03ad0b85165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370893a4-bcfe-4248-a6ee-6febaa7d1bb8', 'volume_name': 'volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35b6c7d-c64f-4cbb-891b-7f638b5ac3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35b6c7d-c64f-4cbb-891b-7f638b5ac3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e00877-e605-454e-92a0-847911a630e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume 370893a4-bcfe-4248-a6ee-6febaa7d1bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8', 'volume_size': 1} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (4d7ba4a7-ada8-4ab0-8e1a-b3a0f12e1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18af51c-de51-45b0-ac20-708ed4fec758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f18af51c-de51-45b0-ac20-708ed4fec758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732475328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2e2f9f-eb13-4861-b791-f53772412ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:09Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb078bc1-3076-4f0c-a73e-fa92f33ce529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb078bc1-3076-4f0c-a73e-fa92f33ce529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd343ae9-ae0b-4406-b6ab-1174cb80e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd343ae9-ae0b-4406-b6ab-1174cb80e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2e2f9f-eb13-4861-b791-f53772412ad4', 'volume_name': 'volume-be2e2f9f-eb13-4861-b791-f53772412ad4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13428f63-6162-4785-82f5-6b2102884856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13428f63-6162-4785-82f5-6b2102884856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f7b24f-b349-4c67-a3d4-1e8483b82ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:08 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume be2e2f9f-eb13-4861-b791-f53772412ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2e2f9f-eb13-4861-b791-f53772412ad4', 'volume_size': 1} Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:08 devstack sudo[113287]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d 1073741824" returned: 0 in 1.053s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:09 devstack sudo[113293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d Jun 27 04:51:09 devstack sudo[113293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (93fe5333-2990-4fff-8170-d9d94d028080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5860cf0-8c90-4f37-ac76-38bbecd39e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5860cf0-8c90-4f37-ac76-38bbecd39e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722209961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae8d004-c23d-4a1d-aacc-8bad03c22256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:09Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d861ebd-e1d6-461c-9608-26bf9c03b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d861ebd-e1d6-461c-9608-26bf9c03b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a287f7fa-466d-4bf3-bea8-a7c419a14502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a287f7fa-466d-4bf3-bea8-a7c419a14502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae8d004-c23d-4a1d-aacc-8bad03c22256', 'volume_name': 'volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad87e0f-7d49-4573-931f-f270b1136bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad87e0f-7d49-4573-931f-f270b1136bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de52c22b-7ab7-444b-a441-501aaa16b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume 9ae8d004-c23d-4a1d-aacc-8bad03c22256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256', 'volume_size': 1} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (39125c1c-1afc-4d5e-a913-25f51f562438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc38352-ec9a-4aad-95be-d88d72d6e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc38352-ec9a-4aad-95be-d88d72d6e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457923054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4568c819-e4e9-4b0c-beea-bd708bef0a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:09Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba1e0dc-beff-445e-b477-7e38be4d4a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba1e0dc-beff-445e-b477-7e38be4d4a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d77bb0-047f-43b8-8995-71c5e4f15ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d77bb0-047f-43b8-8995-71c5e4f15ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4568c819-e4e9-4b0c-beea-bd708bef0a79', 'volume_name': 'volume-4568c819-e4e9-4b0c-beea-bd708bef0a79', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5de64a-4a20-45fa-85aa-3ad048b975b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5de64a-4a20-45fa-85aa-3ad048b975b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12798ba4-b080-4840-960c-f8624ae79e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume 4568c819-e4e9-4b0c-beea-bd708bef0a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4568c819-e4e9-4b0c-beea-bd708bef0a79', 'volume_size': 1} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:09 devstack sudo[113293]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d" returned: 0 in 0.759s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-797428251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370893a4-bcfe-4248-a6ee-6febaa7d1bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:08Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating volume 370893a4-bcfe-4248-a6ee-6febaa7d1bb8 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:09 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:09 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 1073741824 Jun 27 04:51:09 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f85298-3382-4e9c-88f2-e07e42e1c4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1105c713-e8b1-47af-8b3f-0adb61386c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:09 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d (4d138d62-6c81-4e0a-a9f9-2de57000a08d): created successfully Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1105c713-e8b1-47af-8b3f-0adb61386c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:09 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (60518599-829f-45a0-9623-4016c271b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9e1c8967-f4f0-457c-aa7c-2b95b3c0bb50 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created volume successfully. Jun 27 04:51:10 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 1073741824" returned: 0 in 0.915s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:10 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 Jun 27 04:51:10 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:11 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8" returned: 0 in 0.758s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.666s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1732475328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2e2f9f-eb13-4861-b791-f53772412ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:09Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating volume be2e2f9f-eb13-4861-b791-f53772412ad4 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:11 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:11 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 1073741824 Jun 27 04:51:11 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e00877-e605-454e-92a0-847911a630e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fbdf23-7c6f-42f4-ae41-e34284abf064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:11 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 (370893a4-bcfe-4248-a6ee-6febaa7d1bb8): created successfully Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26fbdf23-7c6f-42f4-ae41-e34284abf064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:11 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (ae3d51e2-c169-4829-ada8-b8f8920aec35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7da7589c-b22e-4429-b8b8-1791bcb12ca2 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created volume successfully. Jun 27 04:51:12 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 1073741824" returned: 0 in 0.848s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:12 devstack sudo[113313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 Jun 27 04:51:12 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:13 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4" returned: 0 in 0.742s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.868s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1722209961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae8d004-c23d-4a1d-aacc-8bad03c22256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:09Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating volume 9ae8d004-c23d-4a1d-aacc-8bad03c22256 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:13 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:13 devstack sudo[113316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 1073741824 Jun 27 04:51:13 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f7b24f-b349-4c67-a3d4-1e8483b82ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2e2f9f-eb13-4861-b791-f53772412ad4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cde348-4cfa-4794-9f55-1512f19d4af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:13 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume volume-be2e2f9f-eb13-4861-b791-f53772412ad4 (be2e2f9f-eb13-4861-b791-f53772412ad4): created successfully Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cde348-4cfa-4794-9f55-1512f19d4af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (4d7ba4a7-ada8-4ab0-8e1a-b3a0f12e1d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:13 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3232b985-b045-4750-b433-de94e4ba3ec5 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created volume successfully. Jun 27 04:51:14 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 1073741824" returned: 0 in 0.857s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:14 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 Jun 27 04:51:14 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:14 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256" returned: 0 in 0.677s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.086s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457923054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4568c819-e4e9-4b0c-beea-bd708bef0a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7581055699e6404fbba2f5a43e204372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:09Z,use_quota=True,user_id='b98454dfd2e5436db1bc7594762d0e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Creating volume 4568c819-e4e9-4b0c-beea-bd708bef0a79 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:14 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de52c22b-7ab7-444b-a441-501aaa16b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:14 devstack sudo[113326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 1073741824 Jun 27 04:51:14 devstack sudo[113326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d536a8d6-e166-490e-a317-727349865a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:14 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 (9ae8d004-c23d-4a1d-aacc-8bad03c22256): created successfully Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d536a8d6-e166-490e-a317-727349865a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:14 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (93fe5333-2990-4fff-8170-d9d94d028080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:14 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-37d0146f-da19-402c-be13-d2e2caed8cae tempest-CreateVolumesFromSnapshotTest-798434801 None] Created volume successfully. Jun 27 04:51:15 devstack sudo[113326]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 1073741824" returned: 0 in 0.834s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:15 devstack sudo[113332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 Jun 27 04:51:15 devstack sudo[113332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:16 devstack sudo[113332]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79" returned: 0 in 0.694s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12798ba4-b080-4840-960c-f8624ae79e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4568c819-e4e9-4b0c-beea-bd708bef0a79', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222e9c87-768a-4139-b3d9-431bf7059c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:16 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Volume volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 (4568c819-e4e9-4b0c-beea-bd708bef0a79): created successfully Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222e9c87-768a-4139-b3d9-431bf7059c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:16 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Flow 'volume_create_manager' (39125c1c-1afc-4d5e-a913-25f51f562438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-27ef17e9-c41a-4e7f-a432-54a4d2b751e4 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created volume successfully. Jun 27 04:51:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-4568c819-e4e9-4b0c-beea-bd708bef0a79-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-4568c819-e4e9-4b0c-beea-bd708bef0a79-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-4568c819-e4e9-4b0c-beea-bd708bef0a79" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:17 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-4568c819-e4e9-4b0c-beea-bd708bef0a79" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b27abd5-b8ad-4c3c-ac98-b35d0b6096b2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:17 devstack sudo[113371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 Jun 27 04:51:17 devstack sudo[113371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:18 devstack sudo[113371]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79" returned: 0 in 0.761s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:18 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79 Jun 27 04:51:18 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:18 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4568c819-e4e9-4b0c-beea-bd708bef0a79" returned: 0 in 0.639s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-4568c819-e4e9-4b0c-beea-bd708bef0a79" released by "delete_volume" :: held 1.450s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['a548f2f6-4561-455c-836c-a1ccd4518213', 'c7ea8ac6-1a6c-4659-83af-49b4cbdc51fb', '3bb6b46a-b8b6-4099-bb0f-4ec47a522329', '52d941a2-8745-4bdf-b70f-15ce6c0b6d4e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:18 devstack sudo[113379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:18 devstack sudo[113379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-9ae8d004-c23d-4a1d-aacc-8bad03c22256-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-9ae8d004-c23d-4a1d-aacc-8bad03c22256-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-9ae8d004-c23d-4a1d-aacc-8bad03c22256" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-9ae8d004-c23d-4a1d-aacc-8bad03c22256" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:19 devstack sudo[113379]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.708s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:19 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleted volume successfully. Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce30d6e-9ad4-4581-85a4-990b67a1ab4f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b35bf075-16f0-42f1-b6e1-02821cb52e19 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-4568c819-e4e9-4b0c-beea-bd708bef0a79-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:19 devstack sudo[113388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 Jun 27 04:51:19 devstack sudo[113388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:20 devstack sudo[113388]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256" returned: 0 in 0.785s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:20 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256 Jun 27 04:51:20 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:20 devstack sudo[113395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:20 devstack sudo[113395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:21 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9ae8d004-c23d-4a1d-aacc-8bad03c22256" returned: 0 in 0.628s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-9ae8d004-c23d-4a1d-aacc-8bad03c22256" released by "delete_volume" :: held 1.466s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['7d57e407-7d76-45d9-9934-1a6b47d4d13e', '7e00e378-8665-442e-989a-b9ab5325b1ec', 'f4b8d076-9885-44ff-b39c-3b9ccf27efdf', '595cb4cc-ee0a-4310-97dd-30de14085cc8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:21 devstack sudo[113398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:21 devstack sudo[113398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:21 devstack sudo[113395]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.666s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-be2e2f9f-eb13-4861-b791-f53772412ad4-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-be2e2f9f-eb13-4861-b791-f53772412ad4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-be2e2f9f-eb13-4861-b791-f53772412ad4" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-be2e2f9f-eb13-4861-b791-f53772412ad4" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca59c83-783a-42fe-a9ac-6650e55c5d56]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:21 devstack sudo[113398]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.700s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:21 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleted volume successfully. Jun 27 04:51:21 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5245d93d-e99f-4da5-8097-bf07fa2e06ed tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-9ae8d004-c23d-4a1d-aacc-8bad03c22256-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:21 devstack sudo[113402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 Jun 27 04:51:21 devstack sudo[113402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:22 devstack sudo[113402]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4" returned: 0 in 0.783s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:22 devstack sudo[113408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4 Jun 27 04:51:22 devstack sudo[113408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:23 devstack sudo[113408]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-be2e2f9f-eb13-4861-b791-f53772412ad4" returned: 0 in 0.662s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-be2e2f9f-eb13-4861-b791-f53772412ad4" released by "delete_volume" :: held 1.487s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['cbfadf6d-6c0b-4665-a1cf-2947982e0ade', 'e2721e1b-daed-4bd0-a475-8e0a96cf5da9', 'f1453c82-4995-454a-beaf-f8fc747dd546', '1ddd872b-5dcb-462f-8a0e-271da5d7bf3b'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:23 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:23 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-370893a4-bcfe-4248-a6ee-6febaa7d1bb8-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-370893a4-bcfe-4248-a6ee-6febaa7d1bb8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-370893a4-bcfe-4248-a6ee-6febaa7d1bb8" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-370893a4-bcfe-4248-a6ee-6febaa7d1bb8" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:24 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d32673-d15d-46a5-8b71-a841603fe03b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.677s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleted volume successfully. Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fe277ce9-cce7-4953-822e-109a4d1d0a22 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-be2e2f9f-eb13-4861-b791-f53772412ad4-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:24 devstack sudo[113414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 Jun 27 04:51:24 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:24 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8" returned: 0 in 0.770s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:24 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8 Jun 27 04:51:24 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:25 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-370893a4-bcfe-4248-a6ee-6febaa7d1bb8" returned: 0 in 0.800s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-370893a4-bcfe-4248-a6ee-6febaa7d1bb8" released by "delete_volume" :: held 1.635s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['fca36dda-20f8-499e-82fb-2e8df62cb202', '7502479b-e65e-498f-8634-3495f5c88ae1', '11545c24-f73a-4997-bfc2-0006dafe093b', 'fb690090-6c55-4775-90cf-10d571a2abc0'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:25 devstack sudo[113422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:25 devstack sudo[113422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-4d138d62-6c81-4e0a-a9f9-2de57000a08d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-4d138d62-6c81-4e0a-a9f9-2de57000a08d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-4d138d62-6c81-4e0a-a9f9-2de57000a08d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-4d138d62-6c81-4e0a-a9f9-2de57000a08d" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4a554-15e2-4aa2-a2a8-21585be1c934]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:26 devstack sudo[113424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d Jun 27 04:51:26 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:26 devstack sudo[113422]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.747s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:26 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleted volume successfully. Jun 27 04:51:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-52825e96-1756-4336-96c7-cc49a34301ef tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-370893a4-bcfe-4248-a6ee-6febaa7d1bb8-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:27 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d" returned: 0 in 0.756s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:27 devstack sudo[113430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d Jun 27 04:51:27 devstack sudo[113430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:27 devstack sudo[113430]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-4d138d62-6c81-4e0a-a9f9-2de57000a08d" returned: 0 in 0.746s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-4d138d62-6c81-4e0a-a9f9-2de57000a08d" released by "delete_volume" :: held 1.551s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['af49d118-44fc-49e1-92ea-828c071044b1', '2ba34e8b-ea31-42f4-82d9-a3879a37d411', 'f0b9c694-1be9-4629-af2a-9d7aa0ba22fc', '443ff943-3d17-490d-a516-cbec37e5253a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:27 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:27 devstack sudo[113433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:27 devstack sudo[113433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-f1a2dcf7-b604-4e17-9c74-cd7380f6cbda-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-f1a2dcf7-b604-4e17-9c74-cd7380f6cbda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleting offline snapshot f1a2dcf7-b604-4e17-9c74-cd7380f6cbda of volume 92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] snapshot_file for this snap is: volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb3198-a57b-476b-9c0e-09b099a157c5]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:28 devstack sudo[113433]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.659s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:28 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleted volume successfully. Jun 27 04:51:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-29a503a4-7978-49d9-bd92-839d8ccb9e68 tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-4d138d62-6c81-4e0a-a9f9-2de57000a08d-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:28 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda Jun 27 04:51:28 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:29 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" returned: 0 in 0.770s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:51:29 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ef254-0403-47d9-b9af-1328cf64a6c2]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:29 devstack sudo[113441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c Jun 27 04:51:29 devstack sudo[113441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:30 devstack sudo[113441]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" returned: 0 in 0.730s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:30 devstack sudo[113446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda Jun 27 04:51:30 devstack sudo[113446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:30 devstack sudo[113446]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" returned: 0 in 0.793s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:30 devstack sudo[113451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda Jun 27 04:51:30 devstack sudo[113451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:31 devstack sudo[113451]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c.f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" returned: 0 in 0.628s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-f1a2dcf7-b604-4e17-9c74-cd7380f6cbda" released by "_delete_snapshot" :: held 3.022s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" released by "delete_snapshot" :: held 3.045s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:31 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['637dfba9-f6ee-4cc3-ac0f-cd542269c14f', '27eeaa3e-ecc2-4886-8306-4b412a730453', '08a9478a-7e9a-4bc9-b05d-725b7f4fa58b', '8fed9d34-5a98-4a98-82b6-2b7f0a3bc519'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:31 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Delete snapshot completed successfully. Jun 27 04:51:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-893d9fb7-c409-4f89-800d-b1131292d06d tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-f1a2dcf7-b604-4e17-9c74-cd7380f6cbda-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "cinder-quobyte-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" acquired by "delete_volume" :: waited 0.013s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:32 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[062d59cf-faec-4a3a-ade1-a93e58c0c5ce]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:32 devstack sudo[113456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c Jun 27 04:51:32 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:33 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" returned: 0 in 0.802s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:33 devstack sudo[113461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c Jun 27 04:51:33 devstack sudo[113461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:34 devstack sudo[113461]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" returned: 0 in 0.631s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-quobyte-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c" released by "delete_volume" :: held 1.491s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Created reservations ['5982d256-84d0-494d-8719-875080bcb1d4', '067147f8-9495-4eab-a8f0-cba498092af4', '3d5d6af3-bd21-4373-87da-74a0e94fdd4d', '178f47c9-5d83-45ee-9e04-085ac4397bfe'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:34 devstack sudo[113466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:34 devstack sudo[113466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:35 devstack sudo[113466]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:35 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Deleted volume successfully. Jun 27 04:51:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2be93a08-2cea-4f5e-ac32-d07a8145249b tempest-CreateVolumesFromSnapshotTest-798434801 None] Lock "cinder-92c11d1a-4bd2-433f-83f2-b4c59bb7be0c-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Flow 'volume_create_manager' (e89635ae-d265-437e-96c3-e28e355fd092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adbef33-7393-427d-9961-cbcf9dc2c81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adbef33-7393-427d-9961-cbcf9dc2c81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec484000-3701-429c-b167-bfc64ed6419f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af9d433129740c1ae3e98a13ed2e08b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:40Z,use_quota=True,user_id='8f02fdcb25a5433f9bcf0e6760a863ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fbb9c3-1fa1-4f5f-ac77-e7940743443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fbb9c3-1fa1-4f5f-ac77-e7940743443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a95201-7747-4ba5-a2aa-164d259aa47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a95201-7747-4ba5-a2aa-164d259aa47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec484000-3701-429c-b167-bfc64ed6419f', 'volume_name': 'volume-ec484000-3701-429c-b167-bfc64ed6419f', 'volume_size': 1, 'image_id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2f931fc69cca75673087f7088b6a9e78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1af9d433129740c1ae3e98a13ed2e08b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69e065eca6f566521e21163db993534c4d5a37145312c4acf572d25d768bed12002157ad7fee1f8dc601311215468e7d19119983ce0f14fdd22b631cec67cabd', 'id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'created_at': datetime.datetime(2026, 6, 27, 2, 51, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55/file', 'properties': {}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae54387-25bd-4e11-b062-6f711f6426ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae54387-25bd-4e11-b062-6f711f6426ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bdc05d-a8d3-4af2-9dd5-6c09ccc700d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:40 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Volume ec484000-3701-429c-b167-bfc64ed6419f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec484000-3701-429c-b167-bfc64ed6419f', 'volume_size': 1, 'image_id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2f931fc69cca75673087f7088b6a9e78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1af9d433129740c1ae3e98a13ed2e08b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69e065eca6f566521e21163db993534c4d5a37145312c4acf572d25d768bed12002157ad7fee1f8dc601311215468e7d19119983ce0f14fdd22b631cec67cabd', 'id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'created_at': datetime.datetime(2026, 6, 27, 2, 51, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55/file', 'properties': {}}, 'image_service': } Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Trying to clone ec484000-3701-429c-b167-bfc64ed6419f from image 2fc18e19-d3b8-4819-8e62-a70e4d71df55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:51:40 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Image download 0.00 MB at 0.00 MB/s Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e092f2e0-900e-4a62-8d7b-329bd99f8fe4]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:40 devstack sudo[113470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD Jun 27 04:51:40 devstack sudo[113470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:41 devstack sudo[113470]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:41 devstack sudo[113474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD Jun 27 04:51:41 devstack sudo[113474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:42 devstack sudo[113474]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD" returned: 1 in 0.813s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:51:42 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Temporary image 2fc18e19-d3b8-4819-8e62-a70e4d71df55 is fetched for user 8f02fdcb25a5433f9bcf0e6760a863ec. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:51:42 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[427bc82f-ea88-49eb-a352-acad25520fdd]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:42 devstack sudo[113480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD Jun 27 04:51:42 devstack sudo[113480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:43 devstack sudo[113480]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:43 devstack sudo[113484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD Jun 27 04:51:43 devstack sudo[113484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:43 devstack sudo[113484]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD" returned: 1 in 0.813s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec484000-3701-429c-b167-bfc64ed6419f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1af9d433129740c1ae3e98a13ed2e08b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:40Z,use_quota=True,user_id='8f02fdcb25a5433f9bcf0e6760a863ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Creating volume ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:43 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:43 devstack sudo[113489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f 1073741824 Jun 27 04:51:43 devstack sudo[113489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:44 devstack sudo[113489]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f 1073741824" returned: 0 in 0.935s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:44 devstack sudo[113495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:44 devstack sudo[113495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:45 devstack sudo[113495]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 0 in 0.738s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:51:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:45 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Attempting download of 2fc18e19-d3b8-4819-8e62-a70e4d71df55 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'metadata': {}}])) to volume ec484000-3701-429c-b167-bfc64ed6419f. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:51:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3cd903-2be2-4856-9f9d-d6119ac10c75]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:45 devstack sudo[113498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr Jun 27 04:51:45 devstack sudo[113498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:46 devstack sudo[113498]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr" returned: 0 in 0.843s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:46 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr Jun 27 04:51:46 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:47 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr" returned: 1 in 0.777s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fc18e19-d3b8-4819-8e62-a70e4d71df55_40nguugr' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:51:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307c0d7-1260-42fd-b056-389ae45a7516]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:47 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD Jun 27 04:51:47 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:48 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:48 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD Jun 27 04:51:48 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:48 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:51:48 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] 2fc18e19-d3b8-4819-8e62-a70e4d71df55 was raw, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:51:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:48 devstack sudo[113515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:48 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:49 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 0 in 0.836s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:49 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fc18e19-d3b8-4819-8e62-a70e4d71df55_s3rdivdpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:51:49 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 04:51:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:49 devstack sudo[113520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f 1G Jun 27 04:51:49 devstack sudo[113520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:50 devstack sudo[113520]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f 1G" returned: 0 in 0.742s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:50 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ccc3ba-ad14-448b-b6bc-f9ba8dc6d1a3]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:50 devstack sudo[113525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:50 devstack sudo[113525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:51 devstack sudo[113525]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 0 in 0.797s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:51 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:51 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:52 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 1 in 0.874s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Downloaded image 2fc18e19-d3b8-4819-8e62-a70e4d71df55 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'metadata': {}}])) to volume ec484000-3701-429c-b167-bfc64ed6419f successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Temporary image 2fc18e19-d3b8-4819-8e62-a70e4d71df55 for user 8f02fdcb25a5433f9bcf0e6760a863ec is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Marking volume ec484000-3701-429c-b167-bfc64ed6419f as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Copying metadata from image 2fc18e19-d3b8-4819-8e62-a70e4d71df55 to ec484000-3701-429c-b167-bfc64ed6419f. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Creating volume glance metadata for volume ec484000-3701-429c-b167-bfc64ed6419f backed by image 2fc18e19-d3b8-4819-8e62-a70e4d71df55 with: {'image_id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2f931fc69cca75673087f7088b6a9e78', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1bdc05d-a8d3-4af2-9dd5-6c09ccc700d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec484000-3701-429c-b167-bfc64ed6419f', 'volume_size': 1, 'image_id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2f931fc69cca75673087f7088b6a9e78', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1af9d433129740c1ae3e98a13ed2e08b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69e065eca6f566521e21163db993534c4d5a37145312c4acf572d25d768bed12002157ad7fee1f8dc601311215468e7d19119983ce0f14fdd22b631cec67cabd', 'id': '2fc18e19-d3b8-4819-8e62-a70e4d71df55', 'created_at': datetime.datetime(2026, 6, 27, 2, 51, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 51, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fc18e19-d3b8-4819-8e62-a70e4d71df55/file', 'properties': {}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ec0e1-8f5f-4dce-83ae-fd209476cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:52 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Volume volume-ec484000-3701-429c-b167-bfc64ed6419f (ec484000-3701-429c-b167-bfc64ed6419f): created successfully Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64ec0e1-8f5f-4dce-83ae-fd209476cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Flow 'volume_create_manager' (e89635ae-d265-437e-96c3-e28e355fd092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:52 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-698892e6-4d30-4ee8-95eb-b96083074da6 tempest-VolumeImageDependencyTests-1135281320 None] Created volume successfully. Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Acquiring lock "cinder-ec484000-3701-429c-b167-bfc64ed6419f-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Lock "cinder-ec484000-3701-429c-b167-bfc64ed6419f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Acquiring lock "cinder-quobyte-ec484000-3701-429c-b167-bfc64ed6419f" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Lock "cinder-quobyte-ec484000-3701-429c-b167-bfc64ed6419f" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5bf925-838c-4527-86ca-3baa5d4b436b]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:51:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:53 devstack sudo[113535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:53 devstack sudo[113535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:53 devstack sudo[113535]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 0 in 0.740s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:53 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:53 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:54 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 1 in 0.856s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:51:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:54 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f Jun 27 04:51:54 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:55 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ec484000-3701-429c-b167-bfc64ed6419f" returned: 0 in 0.695s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Lock "cinder-quobyte-ec484000-3701-429c-b167-bfc64ed6419f" released by "delete_volume" :: held 2.360s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Created reservations ['5f0fbf04-4415-4a8c-b975-6d2fe46e0767', 'c59f020d-6c7a-4441-986d-41758dddf005', '000cfa61-c2a4-45f9-8356-23e945f0391f', '1f1da1ba-d474-41fa-884f-6662443a4539'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:55 devstack sudo[113547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:51:55 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:56 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.742s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:56 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:51:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Deleted volume successfully. Jun 27 04:51:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5ba7a627-7ccd-4b62-9135-d4ec10d7988d tempest-VolumeImageDependencyTests-1135281320 None] Lock "cinder-ec484000-3701-429c-b167-bfc64ed6419f-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=83,cinder:SELECT=72,cinder:DELETE=7,cinder:INSERT=24 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=57,cinder:UPDATE=90,cinder:INSERT=25,cinder:DELETE=8 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Flow 'volume_create_manager' (898811c3-959c-4915-b8f0-b83e165be255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5413f0f4-d602-47f5-af18-769d333bb8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5413f0f4-d602-47f5-af18-769d333bb8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c7b8c-3a3a-4458-b004-1483c61bcfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc68503eea8482ba4e2c3e0cfea6669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:59Z,use_quota=True,user_id='1d74820355ec4b3a98205fda9f8ad537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3138db-cbfe-4f71-a86f-a41e0f75e0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3138db-cbfe-4f71-a86f-a41e0f75e0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b40fad-bf0e-4a00-adf1-0560bb0c2ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b40fad-bf0e-4a00-adf1-0560bb0c2ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122c7b8c-3a3a-4458-b004-1483c61bcfcf', 'volume_name': 'volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cf38e8-e619-43dd-9b39-3d9fb8ad9ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cf38e8-e619-43dd-9b39-3d9fb8ad9ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea68792b-1875-4717-aa96-3a48184f03ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:51:59 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Volume 122c7b8c-3a3a-4458-b004-1483c61bcfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf', 'volume_size': 1} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122c7b8c-3a3a-4458-b004-1483c61bcfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc68503eea8482ba4e2c3e0cfea6669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:51:59Z,use_quota=True,user_id='1d74820355ec4b3a98205fda9f8ad537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Creating volume 122c7b8c-3a3a-4458-b004-1483c61bcfcf {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:51:59 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:51:59 devstack sudo[113550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf 1073741824 Jun 27 04:51:59 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:51:59 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf 1073741824" returned: 0 in 0.804s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:51:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:00 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf Jun 27 04:52:00 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:00 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf" returned: 0 in 0.654s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea68792b-1875-4717-aa96-3a48184f03ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920919b1-a314-4e12-b116-3e6654e3c3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:00 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Volume volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf (122c7b8c-3a3a-4458-b004-1483c61bcfcf): created successfully Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920919b1-a314-4e12-b116-3e6654e3c3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Flow 'volume_create_manager' (898811c3-959c-4915-b8f0-b83e165be255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-67770f36-b00c-4ad3-945f-1cdc52782f94 tempest-CinderUnicodeTest-669937605 None] Created volume successfully. Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Flow 'volume_create_manager' (993ff1b3-984a-42fc-b545-690bf092eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a51613-fa2e-490c-a90e-033550fe914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a51613-fa2e-490c-a90e-033550fe914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-924916402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a4dd24-df9f-46e2-bdcc-923161a232f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc68503eea8482ba4e2c3e0cfea6669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:02Z,use_quota=True,user_id='1d74820355ec4b3a98205fda9f8ad537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61643667-5407-47d5-b19b-fcba8ababb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61643667-5407-47d5-b19b-fcba8ababb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc67276d-c68a-4323-a732-355b8ce5d656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc67276d-c68a-4323-a732-355b8ce5d656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a4dd24-df9f-46e2-bdcc-923161a232f0', 'volume_name': 'volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbde9fb1-3778-4f9f-8475-9849cba2d26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbde9fb1-3778-4f9f-8475-9849cba2d26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27313b06-84cf-4d80-a628-e80923f4d5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Volume a1a4dd24-df9f-46e2-bdcc-923161a232f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0', 'volume_size': 1} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-924916402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a4dd24-df9f-46e2-bdcc-923161a232f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfc68503eea8482ba4e2c3e0cfea6669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:02Z,use_quota=True,user_id='1d74820355ec4b3a98205fda9f8ad537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Creating volume a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:01 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:01 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 1073741824 Jun 27 04:52:01 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:02 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 1073741824" returned: 0 in 0.794s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:02 devstack sudo[113564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 Jun 27 04:52:02 devstack sudo[113564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:03 devstack sudo[113564]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0" returned: 0 in 0.634s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27313b06-84cf-4d80-a628-e80923f4d5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c11e82e-4e26-4810-b11f-508b72b47b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:03 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Volume volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 (a1a4dd24-df9f-46e2-bdcc-923161a232f0): created successfully Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c11e82e-4e26-4810-b11f-508b72b47b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Flow 'volume_create_manager' (993ff1b3-984a-42fc-b545-690bf092eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bec7a6ce-e2a3-4d1c-921a-f32fb430f227 tempest-CinderUnicodeTest-669937605 None] Created volume successfully. Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Creating offline snapshot e1e87bd9-6600-406b-80fc-336012557387 of volume a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eda226f-2508-4fe2-bfbc-da7ec657c106]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:04 devstack sudo[113567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 Jun 27 04:52:04 devstack sudo[113567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:04 devstack sudo[113567]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0" returned: 0 in 0.765s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:04 devstack sudo[113572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 1G Jun 27 04:52:04 devstack sudo[113572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:05 devstack sudo[113572]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 1G" returned: 0 in 0.770s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:05 devstack sudo[113579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 Jun 27 04:52:05 devstack sudo[113579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:06 devstack sudo[113579]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387" returned: 0 in 0.689s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:06 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 is being set with open permissions: ugo+rw Jun 27 04:52:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:06 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 Jun 27 04:52:06 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:06 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387" returned: 0 in 0.640s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:06 devstack sudo[113587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info Jun 27 04:52:06 devstack sudo[113587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:07 devstack sudo[113587]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info" returned: 0 in 0.645s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:07 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info is being set with open permissions: ugo+rw Jun 27 04:52:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:07 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info Jun 27 04:52:07 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:08 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.info" returned: 0 in 0.636s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:08 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-7921777c-8d16-4cd9-93b9-56de85f12315 tempest-CinderUnicodeTest-669937605 None] Create snapshot completed successfully Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-e1e87bd9-6600-406b-80fc-336012557387-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Lock "cinder-e1e87bd9-6600-406b-80fc-336012557387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-quobyte-a1a4dd24-df9f-46e2-bdcc-923161a232f0" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-a1a4dd24-df9f-46e2-bdcc-923161a232f0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-quobyte-e1e87bd9-6600-406b-80fc-336012557387" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-e1e87bd9-6600-406b-80fc-336012557387" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Deleting offline snapshot e1e87bd9-6600-406b-80fc-336012557387 of volume a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] snapshot_file for this snap is: volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[9151f74b-2b6f-4b79-b196-f9e82dc58407]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:09 devstack sudo[113593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 Jun 27 04:52:09 devstack sudo[113593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:09 devstack sudo[113593]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387" returned: 0 in 0.731s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:09 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:52:10 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed24dc1-927a-41c0-84c9-4867d0868193]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:10 devstack sudo[113598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 Jun 27 04:52:10 devstack sudo[113598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:10 devstack sudo[113598]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0" returned: 0 in 0.716s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:10 devstack sudo[113603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 Jun 27 04:52:10 devstack sudo[113603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:11 devstack sudo[113603]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387" returned: 0 in 0.700s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:11 devstack sudo[113608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387 Jun 27 04:52:11 devstack sudo[113608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:12 devstack sudo[113608]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0.e1e87bd9-6600-406b-80fc-336012557387" returned: 0 in 0.665s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-e1e87bd9-6600-406b-80fc-336012557387" released by "_delete_snapshot" :: held 2.916s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-a1a4dd24-df9f-46e2-bdcc-923161a232f0" released by "delete_snapshot" :: held 2.937s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Created reservations ['29bb1f59-66bf-460e-9e67-1c776afcec87', 'f88f9dc3-d026-4da1-8256-b7820c10fc21', '4105857e-c509-4d38-a38e-cc4f362a6b73', '2d0e6d65-b2ff-4682-99b9-f9ae0df8def8'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:12 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Delete snapshot completed successfully. Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-fa5434a8-4db1-4d1d-86ef-a525f4f8951a tempest-CinderUnicodeTest-669937605 None] Lock "cinder-e1e87bd9-6600-406b-80fc-336012557387-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-a1a4dd24-df9f-46e2-bdcc-923161a232f0-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-a1a4dd24-df9f-46e2-bdcc-923161a232f0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-quobyte-a1a4dd24-df9f-46e2-bdcc-923161a232f0" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-a1a4dd24-df9f-46e2-bdcc-923161a232f0" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e63007a-cf74-4f34-abc6-e2a20f2ae0fe]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:12 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 Jun 27 04:52:12 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:13 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0" returned: 0 in 0.714s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:13 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0 Jun 27 04:52:13 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:13 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-a1a4dd24-df9f-46e2-bdcc-923161a232f0" returned: 0 in 0.671s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-a1a4dd24-df9f-46e2-bdcc-923161a232f0" released by "delete_volume" :: held 1.440s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Created reservations ['e6fb48e2-e0b5-492f-8090-f4cb3dcdbfe3', '0131ff5a-a1ea-4431-8d3e-52f78d7ec90b', '17417282-53a5-4771-b371-a5f2f8e79505', '91be7ec2-2acd-4b96-b0c9-1963678501f5'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:14 devstack sudo[113620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:14 devstack sudo[113620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-122c7b8c-3a3a-4458-b004-1483c61bcfcf-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-122c7b8c-3a3a-4458-b004-1483c61bcfcf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:14 devstack sudo[113620]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.659s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:14 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Deleted volume successfully. Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "cinder-quobyte-122c7b8c-3a3a-4458-b004-1483c61bcfcf" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-bca3dd84-16d5-4ecc-9a08-20a44ae02464 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-a1a4dd24-df9f-46e2-bdcc-923161a232f0-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-122c7b8c-3a3a-4458-b004-1483c61bcfcf" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76acf7-3f01-4413-a70f-f3484b9fca33]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:14 devstack sudo[113623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf Jun 27 04:52:14 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:15 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf" returned: 0 in 0.762s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:15 devstack sudo[113628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf Jun 27 04:52:15 devstack sudo[113628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:16 devstack sudo[113628]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-122c7b8c-3a3a-4458-b004-1483c61bcfcf" returned: 0 in 0.618s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-quobyte-122c7b8c-3a3a-4458-b004-1483c61bcfcf" released by "delete_volume" :: held 1.420s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Created reservations ['ea525d10-4084-4edc-a57e-ace5b001aafc', 'e69ee3b7-3e38-4d9d-a549-0c06c9df2e2c', '077f2149-1f2f-4389-b101-1b2dfe510a7a', '92ba90c7-cf4b-4436-852d-29b179d0394e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:16 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:16 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:16 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.639s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Deleted volume successfully. Jun 27 04:52:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-32d55e30-e206-44c4-97dc-0590a7b805a6 tempest-CinderUnicodeTest-669937605 None] Lock "cinder-122c7b8c-3a3a-4458-b004-1483c61bcfcf-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:20 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:20 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:21 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.645s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:26 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:UPDATE=27,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=7 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:52:26 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Flow 'volume_create_manager' (860b4114-559e-46b0-a088-0f27b07f9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194669cc-ca2e-4a0a-bc2d-9fbe0409da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194669cc-ca2e-4a0a-bc2d-9fbe0409da62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca82713-9a16-4da2-87ed-cb0eb70ccb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721e723a92604f8d851048bb0cabb8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:28Z,use_quota=True,user_id='a74bce9647d84c119a6b2397d8efb8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f98df4-670a-4565-a7fc-c70f0775a51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f98df4-670a-4565-a7fc-c70f0775a51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efd3f96-f68c-44ca-b42d-3787b2045c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1efd3f96-f68c-44ca-b42d-3787b2045c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca82713-9a16-4da2-87ed-cb0eb70ccb09', 'volume_name': 'volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d24bf2-139d-41eb-9adc-9fe7c873792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d24bf2-139d-41eb-9adc-9fe7c873792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cddce79-e541-4d86-aa7b-483ee49b49c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Volume 2ca82713-9a16-4da2-87ed-cb0eb70ccb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09', 'volume_size': 1} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca82713-9a16-4da2-87ed-cb0eb70ccb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721e723a92604f8d851048bb0cabb8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:28Z,use_quota=True,user_id='a74bce9647d84c119a6b2397d8efb8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Creating volume 2ca82713-9a16-4da2-87ed-cb0eb70ccb09 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:28 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:28 devstack sudo[113719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 1073741824 Jun 27 04:52:28 devstack sudo[113719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (07e6b5cf-7e19-46f4-bb01-72b123d44f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d92505-2fb3-4b57-b856-06c8c5b572c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d92505-2fb3-4b57-b856-06c8c5b572c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730836351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be37730-773d-4b96-9cc6-9a935e2c7e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:29Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71aa9230-9a4e-442b-877b-b57286dde2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71aa9230-9a4e-442b-877b-b57286dde2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f10282-24e4-4481-817b-bac4f3bbb243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f10282-24e4-4481-817b-bac4f3bbb243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be37730-773d-4b96-9cc6-9a935e2c7e3d', 'volume_name': 'volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1040ba05-2e6c-42f6-93e9-1323e7a3250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1040ba05-2e6c-42f6-93e9-1323e7a3250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:28 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87bfa8a-5227-4624-b443-198d386b322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Volume 0be37730-773d-4b96-9cc6-9a935e2c7e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d', 'volume_size': 1} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (c13bae1f-fc99-4d71-99ea-ca730bfe24a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6824aa90-efdb-4c74-8a36-87b97f0b5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6824aa90-efdb-4c74-8a36-87b97f0b5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738701603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011b1491-f40b-4624-b539-64066325b2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:29Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5125414-c14e-461a-8c79-af289103954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5125414-c14e-461a-8c79-af289103954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1bd198-6f22-4e82-9f55-5dff80d487da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1bd198-6f22-4e82-9f55-5dff80d487da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011b1491-f40b-4624-b539-64066325b2f4', 'volume_name': 'volume-011b1491-f40b-4624-b539-64066325b2f4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5c6688-77eb-4c9d-8307-5d3b629b0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5c6688-77eb-4c9d-8307-5d3b629b0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efaa028-b687-46a1-ab95-c643d93c97e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Volume 011b1491-f40b-4624-b539-64066325b2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011b1491-f40b-4624-b539-64066325b2f4', 'volume_size': 1} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (2d296dee-760e-4882-9432-7f547661f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaa60f5-553e-4601-af5e-f193b5afda0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (d865dfac-b06b-414b-ae7c-043635a844c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:29 devstack sudo[113719]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061c1b21-9e8c-486d-9a83-6309cd13b8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 1073741824" returned: 0 in 1.127s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaa60f5-553e-4601-af5e-f193b5afda0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48921511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61749c2-87a0-4af6-be63-16d094425892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12489fc6-2812-4207-9a8e-dc9db18233aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12489fc6-2812-4207-9a8e-dc9db18233aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91f5472-064a-439d-b4e2-4914dd9d3c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91f5472-064a-439d-b4e2-4914dd9d3c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61749c2-87a0-4af6-be63-16d094425892', 'volume_name': 'volume-e61749c2-87a0-4af6-be63-16d094425892', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8778d0-9104-49a8-a0d5-7d827e004c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8778d0-9104-49a8-a0d5-7d827e004c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972645-a854-4c4e-b80f-241f2acf4fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Volume e61749c2-87a0-4af6-be63-16d094425892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61749c2-87a0-4af6-be63-16d094425892', 'volume_size': 1} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (061c1b21-9e8c-486d-9a83-6309cd13b8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999243068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059dc435-b153-40b7-a678-80c4e72d00ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73e240a-97c5-4052-8db3-abd84963b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73e240a-97c5-4052-8db3-abd84963b554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4e929d-fdaf-47dc-8f6d-639e3bb8348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4e929d-fdaf-47dc-8f6d-639e3bb8348b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059dc435-b153-40b7-a678-80c4e72d00ef', 'volume_name': 'volume-059dc435-b153-40b7-a678-80c4e72d00ef', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1d97ba-8748-41fa-8f89-0c184da13e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1d97ba-8748-41fa-8f89-0c184da13e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d4c43a-719f-40d5-b7fe-b6206a6b077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume 059dc435-b153-40b7-a678-80c4e72d00ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059dc435-b153-40b7-a678-80c4e72d00ef', 'volume_size': 1} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:30 devstack sudo[113726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 Jun 27 04:52:30 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (6d559d20-bc01-4823-9623-b61f60b73792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea79d3ab-9956-406b-b8e1-3aa9c1dc17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea79d3ab-9956-406b-b8e1-3aa9c1dc17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451229101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0e09dd-bf37-4b29-bb8e-e6b82db2059f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1aaf78e-b349-4e21-bce5-5791ea0779e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1aaf78e-b349-4e21-bce5-5791ea0779e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeceb0e3-7324-4c84-80c0-ee52baaba22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeceb0e3-7324-4c84-80c0-ee52baaba22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0e09dd-bf37-4b29-bb8e-e6b82db2059f', 'volume_name': 'volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8d2954-f8fa-4f0c-b659-9593753bca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce8d2954-f8fa-4f0c-b659-9593753bca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae3a00-6584-4259-bc28-a2d69274ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Volume ce0e09dd-bf37-4b29-bb8e-e6b82db2059f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f', 'volume_size': 1} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (86a7c660-0391-4f07-ba5b-9d90543f915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed08c26b-cfe3-432d-8a27-4c4051aa8a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed08c26b-cfe3-432d-8a27-4c4051aa8a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1382220800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9036097-ee90-4755-8bb7-0909362446c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b00b50c-caa2-4674-a8aa-5916a8a2ba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b00b50c-caa2-4674-a8aa-5916a8a2ba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a41313-edb9-45cf-bdbd-dbc0c954e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a41313-edb9-45cf-bdbd-dbc0c954e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9036097-ee90-4755-8bb7-0909362446c3', 'volume_name': 'volume-d9036097-ee90-4755-8bb7-0909362446c3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80839a28-bb13-4ac5-8576-9fbca55c14d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80839a28-bb13-4ac5-8576-9fbca55c14d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a594406d-1a4d-4379-88ca-f21414fa8575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Volume d9036097-ee90-4755-8bb7-0909362446c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9036097-ee90-4755-8bb7-0909362446c3', 'volume_size': 1} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:30 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09" returned: 0 in 0.827s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1730836351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be37730-773d-4b96-9cc6-9a935e2c7e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:29Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Creating volume 0be37730-773d-4b96-9cc6-9a935e2c7e3d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:30 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cddce79-e541-4d86-aa7b-483ee49b49c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack sudo[113729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d 1073741824 Jun 27 04:52:30 devstack sudo[113729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba07190-15b5-4b11-81cf-e1adfb791242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:30 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Volume volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 (2ca82713-9a16-4da2-87ed-cb0eb70ccb09): created successfully Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba07190-15b5-4b11-81cf-e1adfb791242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:30 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Flow 'volume_create_manager' (860b4114-559e-46b0-a088-0f27b07f9173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:30 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-510dedf8-79f2-4e8a-86ed-558ef080b56c tempest-CinderUnicodeTest-612247485 None] Created volume successfully. Jun 27 04:52:31 devstack sudo[113729]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d 1073741824" returned: 0 in 0.935s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:31 devstack sudo[113736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d Jun 27 04:52:31 devstack sudo[113736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Flow 'volume_create_manager' (7b38e8f2-1fae-40d3-a285-0a0f04df788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2cd23d-1942-49b5-b700-29402e22bcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2cd23d-1942-49b5-b700-29402e22bcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-248975224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721e723a92604f8d851048bb0cabb8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:32Z,use_quota=True,user_id='a74bce9647d84c119a6b2397d8efb8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2dfc9-391a-4396-864e-61283e3bd55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2dfc9-391a-4396-864e-61283e3bd55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8510fb5-ae7b-4c64-ba06-bafe70148422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8510fb5-ae7b-4c64-ba06-bafe70148422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5', 'volume_name': 'volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfcf244-6700-463e-a2f6-62815274c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfcf244-6700-463e-a2f6-62815274c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f2c11e-b9cf-479f-9780-f7251ea9f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Volume b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5', 'volume_size': 1} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:32 devstack sudo[113736]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d" returned: 0 in 0.734s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.150s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-738701603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=011b1491-f40b-4624-b539-64066325b2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:29Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Creating volume 011b1491-f40b-4624-b539-64066325b2f4 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:32 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87bfa8a-5227-4624-b443-198d386b322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 1073741824 Jun 27 04:52:32 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2f8325-ef3a-44e3-ba2a-c367867068b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Volume volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d (0be37730-773d-4b96-9cc6-9a935e2c7e3d): created successfully Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2f8325-ef3a-44e3-ba2a-c367867068b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (07e6b5cf-7e19-46f4-bb01-72b123d44f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e0ce47ed-7ae0-42c2-a743-d25a5098fb7a tempest-CreateVolumesFromImageTest-1194057039 None] Created volume successfully. Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Flow 'volume_create_manager' (6ce26fb9-c876-471b-8cf5-e8cde6929b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29d882a-e589-444d-97ec-548ce72c7041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29d882a-e589-444d-97ec-548ce72c7041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7a726d-fdb4-4bed-960d-bc06d23f6c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374ce8e3371e4795868e5586be0c6a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:33Z,use_quota=True,user_id='48c9d789ccd24d7ea799a3acf5e5f5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6992954e-d72f-44f6-8229-f9187ce0b0bd),volume_type_id=6992954e-d72f-44f6-8229-f9187ce0b0bd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfb6062-f929-45d2-bd92-ddcf38dfc3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfb6062-f929-45d2-bd92-ddcf38dfc3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e07880-cce7-441b-bc7a-a9018a17c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:32 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e07880-cce7-441b-bc7a-a9018a17c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e7a726d-fdb4-4bed-960d-bc06d23f6c92', 'volume_name': 'volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92', 'volume_size': 1, 'image_id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f27a8ff5812ac5c30afb06c3e09b1796', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '374ce8e3371e4795868e5586be0c6a65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dff00c7997695c34d4e84d873f3980f94a52724860b8255c0de1fa45796315332de4f36ee6443d0fb2687963ad45cd16e8489c45c2706026b6fa640f3d9fc8ea', 'id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'created_at': datetime.datetime(2026, 6, 27, 2, 52, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 52, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b62cec-c914-4246-a33e-1ff6e799c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b62cec-c914-4246-a33e-1ff6e799c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d20cdb0-c2c2-42fb-999a-e2d65a436a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:33 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Volume 0e7a726d-fdb4-4bed-960d-bc06d23f6c92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92', 'volume_size': 1, 'image_id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f27a8ff5812ac5c30afb06c3e09b1796', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '374ce8e3371e4795868e5586be0c6a65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dff00c7997695c34d4e84d873f3980f94a52724860b8255c0de1fa45796315332de4f36ee6443d0fb2687963ad45cd16e8489c45c2706026b6fa640f3d9fc8ea', 'id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'created_at': datetime.datetime(2026, 6, 27, 2, 52, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 52, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Trying to clone 0e7a726d-fdb4-4bed-960d-bc06d23f6c92 from image 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:52:33 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Image download 0.00 MB at 0.00 MB/s Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa632dd5-a989-437d-b54a-f0609c11faad]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:33 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD Jun 27 04:52:33 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:33 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 1073741824" returned: 0 in 0.895s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:33 devstack sudo[113748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 Jun 27 04:52:33 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:34 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:34 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD Jun 27 04:52:34 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:34 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4" returned: 0 in 0.691s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.281s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48921511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61749c2-87a0-4af6-be63-16d094425892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Creating volume e61749c2-87a0-4af6-be63-16d094425892 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:34 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:34 devstack sudo[113757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 1073741824 Jun 27 04:52:34 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efaa028-b687-46a1-ab95-c643d93c97e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011b1491-f40b-4624-b539-64066325b2f4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e3bb42-8c44-4443-a71e-8e857a6e86cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:34 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Volume volume-011b1491-f40b-4624-b539-64066325b2f4 (011b1491-f40b-4624-b539-64066325b2f4): created successfully Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e3bb42-8c44-4443-a71e-8e857a6e86cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (c13bae1f-fc99-4d71-99ea-ca730bfe24a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:34 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2bbf1512-040d-4fee-8375-99f86ffb3383 tempest-CreateVolumesFromImageTest-1194057039 None] Created volume successfully. Jun 27 04:52:34 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD" returned: 1 in 0.785s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Temporary image 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 is fetched for user 48c9d789ccd24d7ea799a3acf5e5f5be. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89d999-07bf-4e3f-a7ef-f1695cc3d07a]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:34 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD Jun 27 04:52:34 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:35 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 1073741824" returned: 0 in 0.909s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:35 devstack sudo[113768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 Jun 27 04:52:35 devstack sudo[113768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:35 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:35 devstack sudo[113768]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:35 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD Jun 27 04:52:35 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892" returned: 0 in 0.649s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.827s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999243068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059dc435-b153-40b7-a678-80c4e72d00ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating volume 059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:35 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:35 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef 1073741824 Jun 27 04:52:35 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b972645-a854-4c4e-b80f-241f2acf4fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61749c2-87a0-4af6-be63-16d094425892', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f75bef-8e76-45fd-bcb9-f408b796c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:35 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Volume volume-e61749c2-87a0-4af6-be63-16d094425892 (e61749c2-87a0-4af6-be63-16d094425892): created successfully Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f75bef-8e76-45fd-bcb9-f408b796c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (2d296dee-760e-4882-9432-7f547661f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d695848b-2c27-48b3-87d8-5a467e5faf88 tempest-CreateVolumesFromImageTest-1194057039 None] Created volume successfully. Jun 27 04:52:36 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD" returned: 1 in 0.748s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:52:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:36 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef 1073741824" returned: 0 in 0.846s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:36 devstack sudo[113784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef Jun 27 04:52:36 devstack sudo[113784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:37 devstack sudo[113784]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef" returned: 0 in 0.624s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-451229101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0e09dd-bf37-4b29-bb8e-e6b82db2059f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Creating volume ce0e09dd-bf37-4b29-bb8e-e6b82db2059f {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:37 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d4c43a-719f-40d5-b7fe-b6206a6b077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059dc435-b153-40b7-a678-80c4e72d00ef', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b9ff32-45dc-4513-8816-db244798581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:37 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f 1073741824 Jun 27 04:52:37 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:37 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume volume-059dc435-b153-40b7-a678-80c4e72d00ef (059dc435-b153-40b7-a678-80c4e72d00ef): created successfully Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b9ff32-45dc-4513-8816-db244798581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:37 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (d865dfac-b06b-414b-ae7c-043635a844c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:37 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b3a96565-1254-432c-9227-68bf369fa1e9 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created volume successfully. Jun 27 04:52:38 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f 1073741824" returned: 0 in 0.874s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:38 devstack sudo[113792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f Jun 27 04:52:38 devstack sudo[113792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:38 devstack sudo[113792]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f" returned: 0 in 0.614s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.223s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1382220800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9036097-ee90-4755-8bb7-0909362446c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0419c50d7e34cb38041b845f43c1748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:30Z,use_quota=True,user_id='213507f2131e4d4f8faf136be230d3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Creating volume d9036097-ee90-4755-8bb7-0909362446c3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:38 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:38 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 1073741824 Jun 27 04:52:38 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ae3a00-6584-4259-bc28-a2d69274ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafe2eea-d9dc-4dc4-8824-617f5895a488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:38 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Volume volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f (ce0e09dd-bf37-4b29-bb8e-e6b82db2059f): created successfully Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafe2eea-d9dc-4dc4-8824-617f5895a488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (6d559d20-bc01-4823-9623-b61f60b73792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ca26afd7-7554-464e-b12d-763dac09047d tempest-CreateVolumesFromImageTest-1194057039 None] Created volume successfully. Jun 27 04:52:39 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 1073741824" returned: 0 in 0.859s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:39 devstack sudo[113801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 Jun 27 04:52:39 devstack sudo[113801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:40 devstack sudo[113801]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3" returned: 0 in 0.632s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.034s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-248975224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721e723a92604f8d851048bb0cabb8e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:32Z,use_quota=True,user_id='a74bce9647d84c119a6b2397d8efb8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Creating volume b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:40 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a594406d-1a4d-4379-88ca-f21414fa8575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9036097-ee90-4755-8bb7-0909362446c3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:40 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 1073741824 Jun 27 04:52:40 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a312b1f0-5f44-4995-b705-cd1bea5b92b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:40 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Volume volume-d9036097-ee90-4755-8bb7-0909362446c3 (d9036097-ee90-4755-8bb7-0909362446c3): created successfully Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a312b1f0-5f44-4995-b705-cd1bea5b92b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:40 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Flow 'volume_create_manager' (86a7c660-0391-4f07-ba5b-9d90543f915d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:40 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ee8e530e-d1c5-482a-92aa-dcca595cf67f tempest-CreateVolumesFromImageTest-1194057039 None] Created volume successfully. Jun 27 04:52:41 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 1073741824" returned: 0 in 0.800s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:41 devstack sudo[113809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 Jun 27 04:52:41 devstack sudo[113809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-d9036097-ee90-4755-8bb7-0909362446c3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-d9036097-ee90-4755-8bb7-0909362446c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-quobyte-d9036097-ee90-4755-8bb7-0909362446c3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-d9036097-ee90-4755-8bb7-0909362446c3" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57fe7d-2000-46b5-9284-3f5276a8a215]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:41 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 Jun 27 04:52:41 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:41 devstack sudo[113809]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" returned: 0 in 0.650s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.459s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7a726d-fdb4-4bed-960d-bc06d23f6c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374ce8e3371e4795868e5586be0c6a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:33Z,use_quota=True,user_id='48c9d789ccd24d7ea799a3acf5e5f5be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6992954e-d72f-44f6-8229-f9187ce0b0bd),volume_type_id=6992954e-d72f-44f6-8229-f9187ce0b0bd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Creating volume 0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:41 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f2c11e-b9cf-479f-9780-f7251ea9f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:41 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 1073741824 Jun 27 04:52:41 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e503130-13b2-45e0-a396-f091c6275b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:41 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Volume volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 (b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5): created successfully Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e503130-13b2-45e0-a396-f091c6275b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Flow 'volume_create_manager' (7b38e8f2-1fae-40d3-a285-0a0f04df788e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-621525b8-04bb-491a-8efa-43332fc4fa58 tempest-CinderUnicodeTest-612247485 None] Created volume successfully. Jun 27 04:52:42 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3" returned: 0 in 0.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:42 devstack sudo[113820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3 Jun 27 04:52:42 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:42 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 1073741824" returned: 0 in 0.849s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:42 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:42 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:42 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d9036097-ee90-4755-8bb7-0909362446c3" returned: 0 in 0.671s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-d9036097-ee90-4755-8bb7-0909362446c3" released by "delete_volume" :: held 1.499s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Created reservations ['5dff4a65-f5e8-4013-8c91-db8e54bb2a19', 'a2bb230f-8dd7-4578-a8e5-d4ef3b694ade', '3677257f-dabc-499f-8a34-5ff981320768', '739e11a0-a091-4133-ae8a-68e30ec6dca9'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:43 devstack sudo[113828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:43 devstack sudo[113828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:43 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 0 in 0.722s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.269s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating offline snapshot e9656b8e-4db6-4053-b837-3769beac9fbd of volume 059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e85b3-cc8e-457c-8b8d-1bd3e41e31c1]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Attempting download of 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'metadata': {}}])) to volume 0e7a726d-fdb4-4bed-960d-bc06d23f6c92. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcf1e97-9a87-4de8-99ae-f19c2f82c3c3]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:43 devstack sudo[113831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef Jun 27 04:52:43 devstack sudo[113831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:43 devstack sudo[113832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8 Jun 27 04:52:43 devstack sudo[113832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-quobyte-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4cd4d2-c716-4b64-b358-989dd6550a4f]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:43 devstack sudo[113828]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.772s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:43 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Deleted volume successfully. Jun 27 04:52:43 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f Jun 27 04:52:43 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:43 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-d4e1ccd4-c758-42ea-a11a-bfca2cd9eaa7 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-d9036097-ee90-4755-8bb7-0909362446c3-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:44 devstack sudo[113831]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef" returned: 0 in 0.818s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:44 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd 1G Jun 27 04:52:44 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:44 devstack sudo[113832]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8" returned: 0 in 0.875s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:44 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8 Jun 27 04:52:44 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:44 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f" returned: 0 in 0.904s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:44 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f Jun 27 04:52:44 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:45 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8" returned: 1 in 0.745s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_6v9lvuv8' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e27ab4-4a19-40b2-9df8-fa61d071fceb]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:45 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd 1G" returned: 0 in 0.876s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059dc435-b153-40b7-a678-80c4e72d00ef -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:45 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059dc435-b153-40b7-a678-80c4e72d00ef -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd Jun 27 04:52:45 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:45 devstack sudo[113859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD Jun 27 04:52:45 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:45 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f" returned: 0 in 0.787s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f" released by "delete_volume" :: held 1.752s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Created reservations ['69a89f7c-8225-4942-b366-0e56970e74bf', '8ffa921f-da5b-4eda-9703-4eef67fb9644', 'a12d8e46-a419-4136-ad9f-37f83c759d7a', '0003a18d-152a-4ca5-817d-dd1874de3003'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:45 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:45 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:45 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:46 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-e61749c2-87a0-4af6-be63-16d094425892-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059dc435-b153-40b7-a678-80c4e72d00ef -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd" returned: 0 in 0.802s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:46 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd is being set with open permissions: ugo+rw Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:46 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-e61749c2-87a0-4af6-be63-16d094425892-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:46 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-quobyte-e61749c2-87a0-4af6-be63-16d094425892" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-e61749c2-87a0-4af6-be63-16d094425892" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a9798-523b-4158-9907-c1f6cd3544b3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:46 devstack sudo[113871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD Jun 27 04:52:46 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:46 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 Jun 27 04:52:46 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:46 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.802s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:46 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Deleted volume successfully. Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3673d036-a02f-4e91-a65c-abedad6f69eb tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-ce0e09dd-bf37-4b29-bb8e-e6b82db2059f-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:46 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd" returned: 0 in 0.738s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:46 devstack sudo[113882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info Jun 27 04:52:46 devstack sudo[113882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:46 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD" returned: 1 in 0.837s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 was raw, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:52:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:46 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:46 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:47 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:47 devstack sudo[113889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892 Jun 27 04:52:47 devstack sudo[113889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:47 devstack sudo[113882]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info" returned: 0 in 0.718s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:47 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info is being set with open permissions: ugo+rw Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:47 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info Jun 27 04:52:47 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:47 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 0 in 0.765s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a4209f1-8d7c-48a8-9eb6-4610f192e0e4_qhioq1yhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:52:47 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:47 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 1G Jun 27 04:52:47 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:47 devstack sudo[113889]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-e61749c2-87a0-4af6-be63-16d094425892" returned: 0 in 0.719s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-e61749c2-87a0-4af6-be63-16d094425892" released by "delete_volume" :: held 1.698s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Created reservations ['281162ef-38c0-40d3-bdfe-e1144f3086ac', 'eb485c6e-91b8-40d0-ae75-b1222a5a6add', '99b9f446-f310-4aff-93ea-57e69787ec54', '279cb6ab-1042-411a-bcb1-2f606921860d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:47 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:47 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:48 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.info" returned: 0 in 0.688s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.738s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.147s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Creating offline snapshot 49e7d156-48b3-4d98-9435-c2b33dadef6a of volume b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:52:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-65cae62a-bd1c-4732-bc99-5fccafa72cd6 tempest-CreateVolumesFromSnapshotTest-18672927 None] Create snapshot completed successfully Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2717ed-abbe-4b21-8f37-208ead6bfdc6]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-011b1491-f40b-4624-b539-64066325b2f4-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-011b1491-f40b-4624-b539-64066325b2f4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-quobyte-011b1491-f40b-4624-b539-64066325b2f4" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-011b1491-f40b-4624-b539-64066325b2f4" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:48 devstack sudo[113906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 Jun 27 04:52:48 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:48 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 1G" returned: 0 in 0.863s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af82623-828c-4334-bf20-5f3068fe33a4]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb98d5-b66a-4ba0-b847-61f6fb68bde0]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:48 devstack sudo[113909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 Jun 27 04:52:48 devstack sudo[113909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:48 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:48 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:48 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.002s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:48 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:48 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Deleted volume successfully. Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-ee24d118-7661-4d0d-8acc-2109f6930150 tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-e61749c2-87a0-4af6-be63-16d094425892-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (eb711ed6-b255-4a77-a40c-3d7194588f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95e8dc0-293f-4ff8-ae53-7bb779d1adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95e8dc0-293f-4ff8-ae53-7bb779d1adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1966720760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d531509b-f122-44fa-82f9-82cbd37842f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:49Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ea3974-7be5-49ff-bb6c-3420546bc5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ea3974-7be5-49ff-bb6c-3420546bc5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0787383-f8b2-4736-a11b-601472478dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0787383-f8b2-4736-a11b-601472478dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd531509b-f122-44fa-82f9-82cbd37842f3', 'volume_name': 'volume-d531509b-f122-44fa-82f9-82cbd37842f3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ad6936-0eb2-404c-ba17-a3512fcb1924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ad6936-0eb2-404c-ba17-a3512fcb1924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4ef6f6-4733-445a-9b78-78798f2f4f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume d531509b-f122-44fa-82f9-82cbd37842f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d531509b-f122-44fa-82f9-82cbd37842f3', 'volume_size': 1} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:49 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" returned: 0 in 1.215s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:49 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a 1G Jun 27 04:52:49 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:49 devstack sudo[113909]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4" returned: 0 in 1.168s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:49 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4 Jun 27 04:52:49 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:49 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 0 in 1.202s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (717e0cff-53b0-45dc-ac56-972d66e81bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49983824-3ccf-4643-8c23-f500b9795ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:49 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49983824-3ccf-4643-8c23-f500b9795ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207864404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a63abf-25c9-4f30-b9a1-da34eaed8ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:50Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d408229b-4f1e-467d-9f24-4a56bb137781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d408229b-4f1e-467d-9f24-4a56bb137781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e563d568-a078-4b1d-847d-00e312fdc61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e563d568-a078-4b1d-847d-00e312fdc61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a63abf-25c9-4f30-b9a1-da34eaed8ee1', 'volume_name': 'volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:49 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fb3159-b593-41fe-b264-ea0682fc86d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fb3159-b593-41fe-b264-ea0682fc86d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ffcce0-2749-46ba-83dc-39c13e1fcd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume 02a63abf-25c9-4f30-b9a1-da34eaed8ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1', 'volume_size': 1} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (09ccd427-f048-4223-b325-c8c72216408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a946b620-25d7-4b81-b789-23982f244a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a946b620-25d7-4b81-b789-23982f244a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332178857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7f3d9f-47cf-4c58-9190-a889fb31eb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:50Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37e9093-214f-44a6-8656-4ce4f4cbf051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37e9093-214f-44a6-8656-4ce4f4cbf051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c13abbc-87ef-4d2b-8c99-f3dc1e8fd2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c13abbc-87ef-4d2b-8c99-f3dc1e8fd2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7f3d9f-47cf-4c58-9190-a889fb31eb10', 'volume_name': 'volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d91aa8e-27a9-4add-9d32-63d7317f5856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d91aa8e-27a9-4add-9d32-63d7317f5856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3854a88e-d3e4-415c-9deb-a7030f3d77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume 2c7f3d9f-47cf-4c58-9190-a889fb31eb10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10', 'volume_size': 1} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:50 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (18be54ac-c563-48ad-adc4-1b5e8d0ff8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cd563d-5164-422b-8178-5e40f9c57b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a 1G" returned: 0 in 1.246s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:50 devstack sudo[113937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a Jun 27 04:52:50 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cd563d-5164-422b-8178-5e40f9c57b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1050230435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3199a2f-c778-4908-b902-558b14924846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:51Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882ca0f3-739c-4b1e-8485-d4381f0692fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882ca0f3-739c-4b1e-8485-d4381f0692fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7751f025-2342-45c8-92fd-c98b07ad5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7751f025-2342-45c8-92fd-c98b07ad5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3199a2f-c778-4908-b902-558b14924846', 'volume_name': 'volume-f3199a2f-c778-4908-b902-558b14924846', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d37eee-cf12-44bd-b291-d2b7fee578a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d37eee-cf12-44bd-b291-d2b7fee578a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493dffcf-ee50-4730-bae0-b9c39240eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume f3199a2f-c778-4908-b902-558b14924846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3199a2f-c778-4908-b902-558b14924846', 'volume_size': 1} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:50 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 1 in 1.185s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Downloaded image 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'metadata': {}}])) to volume 0e7a726d-fdb4-4bed-960d-bc06d23f6c92 successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Temporary image 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 for user 48c9d789ccd24d7ea799a3acf5e5f5be is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Marking volume 0e7a726d-fdb4-4bed-960d-bc06d23f6c92 as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Copying metadata from image 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 to 0e7a726d-fdb4-4bed-960d-bc06d23f6c92. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Creating volume glance metadata for volume 0e7a726d-fdb4-4bed-960d-bc06d23f6c92 backed by image 5a4209f1-8d7c-48a8-9eb6-4610f192e0e4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f27a8ff5812ac5c30afb06c3e09b1796', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:52:50 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-011b1491-f40b-4624-b539-64066325b2f4" returned: 0 in 1.333s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-011b1491-f40b-4624-b539-64066325b2f4" released by "delete_volume" :: held 2.557s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d20cdb0-c2c2-42fb-999a-e2d65a436a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92', 'volume_size': 1, 'image_id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f27a8ff5812ac5c30afb06c3e09b1796', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '374ce8e3371e4795868e5586be0c6a65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dff00c7997695c34d4e84d873f3980f94a52724860b8255c0de1fa45796315332de4f36ee6443d0fb2687963ad45cd16e8489c45c2706026b6fa640f3d9fc8ea', 'id': '5a4209f1-8d7c-48a8-9eb6-4610f192e0e4', 'created_at': datetime.datetime(2026, 6, 27, 2, 52, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 52, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a4209f1-8d7c-48a8-9eb6-4610f192e0e4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c748b6f-27c7-4c41-92c2-772846872438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Created reservations ['d28b8368-acdd-4629-9214-2ece8dcf0baf', 'b5f732f1-c7c0-4290-990e-a2de703aea9f', 'f8888130-f44d-4ee3-bf97-dd4f92023ba1', '7bad8cf1-b472-404e-b4ae-a984ff062801'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:51 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Volume volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 (0e7a726d-fdb4-4bed-960d-bc06d23f6c92): created successfully Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c748b6f-27c7-4c41-92c2-772846872438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Flow 'volume_create_manager' (6ce26fb9-c876-471b-8cf5-e8cde6929b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1398dac9-8c1f-4639-b795-d2e08c02b5a4 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Created volume successfully. Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (5bd41d75-e089-4b76-83ab-2561faa36a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f7ac68-9eb4-4ed6-8e2c-b6499b89305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:51 devstack sudo[113939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f7ac68-9eb4-4ed6-8e2c-b6499b89305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-537443408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fb8a23-94d1-4309-b475-76060b01be7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:51Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:51 devstack sudo[113939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4053e977-345b-4066-b8c8-eb40d4f0ad17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4053e977-345b-4066-b8c8-eb40d4f0ad17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67531bb4-e758-4099-8175-ef0792119395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67531bb4-e758-4099-8175-ef0792119395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7fb8a23-94d1-4309-b475-76060b01be7d', 'volume_name': 'volume-c7fb8a23-94d1-4309-b475-76060b01be7d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f36369-4dfd-4a71-be75-e39e64d4e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f36369-4dfd-4a71-be75-e39e64d4e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac2a360-cd65-40a6-8538-3485ca97762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:51 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume c7fb8a23-94d1-4309-b475-76060b01be7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7fb8a23-94d1-4309-b475-76060b01be7d', 'volume_size': 1} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:51 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:51 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a is being set with open permissions: ugo+rw Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:51 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a Jun 27 04:52:51 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-0be37730-773d-4b96-9cc6-9a935e2c7e3d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-0be37730-773d-4b96-9cc6-9a935e2c7e3d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "cinder-quobyte-0be37730-773d-4b96-9cc6-9a935e2c7e3d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-0be37730-773d-4b96-9cc6-9a935e2c7e3d" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46fa65d-bbaf-4e6f-9a9b-2ba1127b6a56]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:51 devstack sudo[113939]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.661s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Deleted volume successfully. Jun 27 04:52:51 devstack sudo[113947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d Jun 27 04:52:51 devstack sudo[113947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-8ac7a0ec-73ed-4463-a3e2-a3d2bc82111c tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-011b1491-f40b-4624-b539-64066325b2f4-delete_volume" released by "delete_volume" :: held 3.589s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Acquiring lock "cinder-0e7a726d-fdb4-4bed-960d-bc06d23f6c92-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "cinder-0e7a726d-fdb4-4bed-960d-bc06d23f6c92-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Acquiring lock "cinder-quobyte-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "cinder-quobyte-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:52 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a" returned: 0 in 0.749s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e7a74c-efcd-4c7f-8c02-404f500a4f7c]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:52 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info Jun 27 04:52:52 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:52 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:52 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:52 devstack sudo[113947]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d" returned: 0 in 0.858s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:52 devstack sudo[113958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d Jun 27 04:52:52 devstack sudo[113958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:53 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info" returned: 0 in 0.666s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:53 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info is being set with open permissions: ugo+rw Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:53 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info Jun 27 04:52:53 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:53 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:53 devstack sudo[113965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:53 devstack sudo[113965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:53 devstack sudo[113958]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0be37730-773d-4b96-9cc6-9a935e2c7e3d" returned: 0 in 0.721s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-quobyte-0be37730-773d-4b96-9cc6-9a935e2c7e3d" released by "delete_volume" :: held 1.629s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Created reservations ['2d30c1f5-7902-410c-b88e-327c112ef181', 'f84fcd1b-0b0a-4858-8594-0644725b7bf5', 'ef0ba200-d41b-4fde-8e16-4a68655ae30b', '6b61f8b4-caac-4cd5-9ee3-965f4336db44'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:53 devstack sudo[113968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:53 devstack sudo[113968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:53 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.info" returned: 0 in 0.713s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.560s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.316s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1966720760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d531509b-f122-44fa-82f9-82cbd37842f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:49Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating volume d531509b-f122-44fa-82f9-82cbd37842f3 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:53 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:53 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:53 devstack sudo[113971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 1073741824 Jun 27 04:52:53 devstack sudo[113971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:53 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-68b91bea-a94e-42a4-9fe5-43be8beee80a tempest-CinderUnicodeTest-612247485 None] Create snapshot completed successfully Jun 27 04:52:54 devstack sudo[113965]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 1 in 0.893s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:54 devstack sudo[113976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92 Jun 27 04:52:54 devstack sudo[113976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:54 devstack sudo[113968]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.775s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:54 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Deleted volume successfully. Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-5a0a2b03-0d51-4156-980f-8b1f17d6b27d tempest-CreateVolumesFromImageTest-1194057039 None] Lock "cinder-0be37730-773d-4b96-9cc6-9a935e2c7e3d-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-49e7d156-48b3-4d98-9435-c2b33dadef6a-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Lock "cinder-49e7d156-48b3-4d98-9435-c2b33dadef6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-quobyte-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-quobyte-49e7d156-48b3-4d98-9435-c2b33dadef6a" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-49e7d156-48b3-4d98-9435-c2b33dadef6a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Deleting offline snapshot 49e7d156-48b3-4d98-9435-c2b33dadef6a of volume b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] snapshot_file for this snap is: volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0977f5-3151-4a40-abfa-c7b9bdafa7fe]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:54 devstack sudo[113971]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 1073741824" returned: 0 in 1.111s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:54 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a Jun 27 04:52:54 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:54 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 Jun 27 04:52:54 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:54 devstack sudo[113976]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" returned: 0 in 0.926s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "cinder-quobyte-0e7a726d-fdb4-4bed-960d-bc06d23f6c92" released by "delete_volume" :: held 2.729s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Created reservations ['5186d721-63da-4f33-a1e9-ea02958e582e', '7e3380c1-256c-4c54-92ff-e1fc2e34f79d', '5d9d0b4d-55f1-4e09-8580-4fa5ab0a4d88', '60a13eb1-a0b9-4f60-86e1-33d92c84de34'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:55 devstack sudo[113988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:52:55 devstack sudo[113988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:56 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3" returned: 0 in 1.143s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.077s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1207864404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a63abf-25c9-4f30-b9a1-da34eaed8ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:50Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating volume 02a63abf-25c9-4f30-b9a1-da34eaed8ee1 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:56 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:56 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a" returned: 0 in 1.374s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:52:56 devstack sudo[113996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 1073741824 Jun 27 04:52:56 devstack sudo[113996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:56 devstack sudo[113988]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4ef6f6-4733-445a-9b78-78798f2f4f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d531509b-f122-44fa-82f9-82cbd37842f3', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43cde6-aa62-4ca2-a9d7-06bad86a1853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03376a2-d230-4fad-a5d2-f8f19005485c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.092s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:52:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Deleted volume successfully. Jun 27 04:52:56 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume volume-d531509b-f122-44fa-82f9-82cbd37842f3 (d531509b-f122-44fa-82f9-82cbd37842f3): created successfully Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db43cde6-aa62-4ca2-a9d7-06bad86a1853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (eb711ed6-b255-4a77-a40c-3d7194588f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-5a6da915-e6bf-48e4-b2be-1d5dafe46a6f tempest-CreateVolumesFromSnapshotTest-18672927 None] Created volume successfully. Jun 27 04:52:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1ff241a1-dff2-4d6a-822e-ab38376e8fd1 tempest-VolumeAndVolumeTypeFromImageTest-502299674 None] Lock "cinder-0e7a726d-fdb4-4bed-960d-bc06d23f6c92-delete_volume" released by "delete_volume" :: held 4.118s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:56 devstack sudo[113998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 Jun 27 04:52:56 devstack sudo[113998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:57 devstack sudo[113998]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" returned: 0 in 0.944s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:57 devstack sudo[114007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a Jun 27 04:52:57 devstack sudo[114007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:57 devstack sudo[113996]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 1073741824" returned: 0 in 1.106s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:57 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 Jun 27 04:52:57 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:57 devstack sudo[114007]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a" returned: 0 in 0.827s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:58 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a Jun 27 04:52:58 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:58 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.763s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332178857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7f3d9f-47cf-4c58-9190-a889fb31eb10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:50Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating volume 2c7f3d9f-47cf-4c58-9190-a889fb31eb10 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:58 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:58 devstack sudo[114017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 1073741824 Jun 27 04:52:58 devstack sudo[114017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ffcce0-2749-46ba-83dc-39c13e1fcd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4502f80-63d0-431b-a8f5-8a859895493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:52:58 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 (02a63abf-25c9-4f30-b9a1-da34eaed8ee1): created successfully Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4502f80-63d0-431b-a8f5-8a859895493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (717e0cff-53b0-45dc-ac56-972d66e81bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:52:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f026dfb9-9e7a-4d96-8cf4-d492e161f829 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created volume successfully. Jun 27 04:52:58 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5.49e7d156-48b3-4d98-9435-c2b33dadef6a" returned: 0 in 0.692s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-49e7d156-48b3-4d98-9435-c2b33dadef6a" released by "_delete_snapshot" :: held 4.020s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" released by "delete_snapshot" :: held 4.058s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Created reservations ['189eb20f-f204-47ab-b1de-952fd08d37d8', '82845d9d-db85-447d-851e-334a951ae4ec', '27c203ca-c6cf-47c7-a43b-7d184f6eaf6a', '7f89e1b9-c44b-44a1-95c7-703fcf03d9ab'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:52:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Delete snapshot completed successfully. Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bf42087-8fab-457a-91c7-685e56c0ad1a tempest-CinderUnicodeTest-612247485 None] Lock "cinder-49e7d156-48b3-4d98-9435-c2b33dadef6a-delete_snapshot" released by "delete_snapshot" :: held 4.226s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:52:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Lock "cinder-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-quobyte-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:52:59 devstack sudo[114017]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 1073741824" returned: 0 in 1.067s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12ad7a3-53f4-4d3c-967b-974bf3a4609e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:59 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 Jun 27 04:52:59 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:59 devstack sudo[114024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 Jun 27 04:52:59 devstack sudo[114024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:52:59 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.116s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1050230435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3199a2f-c778-4908-b902-558b14924846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:51Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating volume f3199a2f-c778-4908-b902-558b14924846 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:52:59 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:52:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:52:59 devstack sudo[114024]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" returned: 0 in 0.830s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:00 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 1073741824 Jun 27 04:53:00 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3854a88e-d3e4-415c-9deb-a7030f3d77f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41471a0d-8b39-4daa-a2b8-4c7d8746758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:00 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5 Jun 27 04:53:00 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:00 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 (2c7f3d9f-47cf-4c58-9190-a889fb31eb10): created successfully Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41471a0d-8b39-4daa-a2b8-4c7d8746758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (09ccd427-f048-4223-b325-c8c72216408f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:00 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cb97ac6a-a395-4a3a-a47b-448079b3b130 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created volume successfully. Jun 27 04:53:00 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" returned: 0 in 0.809s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5" released by "delete_volume" :: held 1.723s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Created reservations ['43a3a849-9ad6-409a-9e5c-bdc3dcc9d75d', '462bf999-4d09-4e5f-8ea1-e27d37dbe29a', 'bae0944d-b432-47ef-be85-7f500a117870', 'e9b4c1a1-c86f-41fc-8039-1dfafba0e9f4'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:00 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 1073741824" returned: 0 in 0.997s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Flow 'volume_create_manager' (2b1734c3-e4a7-44c2-9c05-ccd363853d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298bb70-2b74-4b17-bab9-b725bcba1b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b298bb70-2b74-4b17-bab9-b725bcba1b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1623097045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b1cb51-edb1-4346-ba09-65ea66c428ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd28beee9f43b9b79c4ad267bf8470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:01Z,use_quota=True,user_id='d0c6aaf15ccf46be8c7322d36229c4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b528ec-ac38-4671-b7b2-4029e665a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b528ec-ac38-4671-b7b2-4029e665a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9391374c-3479-4376-98e9-7464d3377156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9391374c-3479-4376-98e9-7464d3377156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b1cb51-edb1-4346-ba09-65ea66c428ce', 'volume_name': 'volume-52b1cb51-edb1-4346-ba09-65ea66c428ce', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d39292-4c5f-4e9f-9f0b-aeb8978a3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d39292-4c5f-4e9f-9f0b-aeb8978a3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709ca63f-b6a0-4b04-927e-55e7f3a731bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Volume 52b1cb51-edb1-4346-ba09-65ea66c428ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b1cb51-edb1-4346-ba09-65ea66c428ce', 'volume_size': 1} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:01 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 Jun 27 04:53:01 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:01 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:01 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-2ca82713-9a16-4da2-87ed-cb0eb70ccb09-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Lock "cinder-2ca82713-9a16-4da2-87ed-cb0eb70ccb09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Acquiring lock "cinder-quobyte-2ca82713-9a16-4da2-87ed-cb0eb70ccb09" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-2ca82713-9a16-4da2-87ed-cb0eb70ccb09" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[3490d658-63a9-49d8-a240-6ba3a770a306]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:01 devstack sudo[114045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 Jun 27 04:53:01 devstack sudo[114045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:01 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846" returned: 0 in 0.676s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.513s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-537443408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7fb8a23-94d1-4309-b475-76060b01be7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ea98047b4341e18169e3a86896eedc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:52:51Z,use_quota=True,user_id='10924d10ca6545aea51792215ea1b606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Creating volume c7fb8a23-94d1-4309-b475-76060b01be7d {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:01 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:01 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.689s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:01 devstack sudo[114049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d 1073741824 Jun 27 04:53:01 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493dffcf-ee50-4730-bae0-b9c39240eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3199a2f-c778-4908-b902-558b14924846', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a0b0c6-2e29-48ae-b045-afea642db095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:01 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Deleted volume successfully. Jun 27 04:53:01 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume volume-f3199a2f-c778-4908-b902-558b14924846 (f3199a2f-c778-4908-b902-558b14924846): created successfully Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a0b0c6-2e29-48ae-b045-afea642db095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (18be54ac-c563-48ad-adc4-1b5e8d0ff8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:01 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ee9d422b-28d9-4db9-9408-4ba68c0ea11d tempest-CreateVolumesFromSnapshotTest-18672927 None] Created volume successfully. Jun 27 04:53:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-dab04aff-7c24-41f8-a3d5-ff8a2dd4386f tempest-CinderUnicodeTest-612247485 None] Lock "cinder-b4beefcf-cdd2-4c2b-b0cb-166dfb3c6de5-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:02 devstack sudo[114045]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09" returned: 0 in 0.873s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:02 devstack sudo[114055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09 Jun 27 04:53:02 devstack sudo[114055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:02 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d 1073741824" returned: 0 in 0.934s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:02 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d Jun 27 04:53:02 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:02 devstack sudo[114055]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2ca82713-9a16-4da2-87ed-cb0eb70ccb09" returned: 0 in 0.694s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Lock "cinder-quobyte-2ca82713-9a16-4da2-87ed-cb0eb70ccb09" released by "delete_volume" :: held 1.630s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Created reservations ['1015bff4-7c63-414c-a426-26ab661fc44a', '594ecdea-4d8c-4ca3-8199-5d0f88b2a827', 'c210e0ce-4365-4386-a20a-44e51fcdfd92', 'c78d9509-b426-4bbc-94ba-a01fc09b3f02'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:03 devstack sudo[114063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:03 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:03 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d" returned: 0 in 0.681s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.361s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1623097045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b1cb51-edb1-4346-ba09-65ea66c428ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd28beee9f43b9b79c4ad267bf8470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:01Z,use_quota=True,user_id='d0c6aaf15ccf46be8c7322d36229c4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Creating volume 52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:03 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac2a360-cd65-40a6-8538-3485ca97762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7fb8a23-94d1-4309-b475-76060b01be7d', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e0a0d7-5ade-40f0-8117-323c864d21b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:03 devstack sudo[114066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce 1073741824 Jun 27 04:53:03 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:03 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Volume volume-c7fb8a23-94d1-4309-b475-76060b01be7d (c7fb8a23-94d1-4309-b475-76060b01be7d): created successfully Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e0a0d7-5ade-40f0-8117-323c864d21b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Flow 'volume_create_manager' (5bd41d75-e089-4b76-83ab-2561faa36a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-8d4322f1-e4de-4d2f-80a4-3e28732b4243 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created volume successfully. Jun 27 04:53:03 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.684s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:03 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Deleted volume successfully. Jun 27 04:53:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-a71d83a5-352c-45fd-b859-e09e5984e2f0 tempest-CinderUnicodeTest-612247485 None] Lock "cinder-2ca82713-9a16-4da2-87ed-cb0eb70ccb09-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-c7fb8a23-94d1-4309-b475-76060b01be7d-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-c7fb8a23-94d1-4309-b475-76060b01be7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-c7fb8a23-94d1-4309-b475-76060b01be7d" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-c7fb8a23-94d1-4309-b475-76060b01be7d" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2113226-a590-4cf7-be50-91faf14d8f8b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:04 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce 1073741824" returned: 0 in 1.051s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:04 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:04 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:04 devstack sudo[114073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d Jun 27 04:53:04 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:05 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 0.783s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709ca63f-b6a0-4b04-927e-55e7f3a731bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b1cb51-edb1-4346-ba09-65ea66c428ce', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d77bf99-11b7-48a4-ae4e-bbaab832a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:05 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Volume volume-52b1cb51-edb1-4346-ba09-65ea66c428ce (52b1cb51-edb1-4346-ba09-65ea66c428ce): created successfully Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d77bf99-11b7-48a4-ae4e-bbaab832a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Flow 'volume_create_manager' (2b1734c3-e4a7-44c2-9c05-ccd363853d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:05 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-55b4aa4a-4635-401a-868f-c721a806cfd2 tempest-VolumeDependencyTests-1905443612 None] Created volume successfully. Jun 27 04:53:05 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:05 devstack sudo[114081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d Jun 27 04:53:05 devstack sudo[114081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:06 devstack sudo[114081]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-c7fb8a23-94d1-4309-b475-76060b01be7d" returned: 0 in 0.736s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-c7fb8a23-94d1-4309-b475-76060b01be7d" released by "delete_volume" :: held 1.718s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['f7b0387a-93cd-440f-84e7-7b634bff1cbf', 'c3698d3d-aba7-439a-bb43-b27a5993b4ab', '6d993892-d6be-4c40-8a3f-c1c4c45e707f', 'c74ba19d-8cdf-45cf-a6b4-e624920dd8d4'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:06 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:06 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Creating offline snapshot 8da7cdfd-c55a-4802-a50d-02905ccbf262 of volume 52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3adb4c7-04a7-4f4c-892f-c3a19a162cd8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-f3199a2f-c778-4908-b902-558b14924846-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-f3199a2f-c778-4908-b902-558b14924846-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:06 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:06 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-f3199a2f-c778-4908-b902-558b14924846" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-f3199a2f-c778-4908-b902-558b14924846" acquired by "delete_volume" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c5678-137a-4788-b3f9-83001a333cdb]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:07 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 Jun 27 04:53:07 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:07 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.995s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleted volume successfully. Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-98a26af4-476c-4d7c-99a9-86e313a59340 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-c7fb8a23-94d1-4309-b475-76060b01be7d-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:07 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 1.149s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:07 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 1G Jun 27 04:53:07 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:07 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846" returned: 0 in 1.089s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:07 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846 Jun 27 04:53:07 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:08 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:08 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 1G" returned: 0 in 0.975s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b1cb51-edb1-4346-ba09-65ea66c428ce -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-f3199a2f-c778-4908-b902-558b14924846" returned: 0 in 0.779s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:08 devstack sudo[114108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b1cb51-edb1-4346-ba09-65ea66c428ce -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-f3199a2f-c778-4908-b902-558b14924846" released by "delete_volume" :: held 1.918s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:08 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['6efcae7a-a7e4-424d-93a7-fc26010ff9e1', 'bf998109-9e4e-4f4c-98bd-ff35f22f15dc', 'e0febe11-1f20-4c71-84a5-c623a6c90c41', '5031155b-0556-4edc-8b3b-b125b45d8535'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:08 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:08 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-2c7f3d9f-47cf-4c58-9190-a889fb31eb10-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-2c7f3d9f-47cf-4c58-9190-a889fb31eb10-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-2c7f3d9f-47cf-4c58-9190-a889fb31eb10" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-2c7f3d9f-47cf-4c58-9190-a889fb31eb10" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830c36b-aa7f-4637-b903-5f2cc52f7edd]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:09 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 Jun 27 04:53:09 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:09 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b1cb51-edb1-4346-ba09-65ea66c428ce -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262" returned: 0 in 0.811s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:09 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 is being set with open permissions: ugo+rw Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:09 devstack sudo[114118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 Jun 27 04:53:09 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:09 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleted volume successfully. Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2f40cc0f-4534-4635-b86b-ffcc925cb083 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-f3199a2f-c778-4908-b902-558b14924846-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:09 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10" returned: 0 in 0.769s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:10 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10 Jun 27 04:53:10 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:10 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262" returned: 0 in 0.754s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:10 devstack sudo[114127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info Jun 27 04:53:10 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:10 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-2c7f3d9f-47cf-4c58-9190-a889fb31eb10" returned: 0 in 0.775s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-2c7f3d9f-47cf-4c58-9190-a889fb31eb10" released by "delete_volume" :: held 1.604s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['664524df-2d96-44cc-8bba-3dea079bed93', '7d2cb7d2-656a-4dfc-9222-83aa55bd90e5', '74ea14d2-4c04-46c1-aeaa-dab0cf0d7d82', 'c006d9cd-2d5c-4a17-8ddd-6162c74580a6'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:10 devstack sudo[114131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:10 devstack sudo[114131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:11 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info" returned: 0 in 0.759s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:11 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info is being set with open permissions: ugo+rw Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:11 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info Jun 27 04:53:11 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-02a63abf-25c9-4f30-b9a1-da34eaed8ee1-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-02a63abf-25c9-4f30-b9a1-da34eaed8ee1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-02a63abf-25c9-4f30-b9a1-da34eaed8ee1" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-02a63abf-25c9-4f30-b9a1-da34eaed8ee1" acquired by "delete_volume" :: waited 0.020s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb23f77-1488-4168-9279-e0d18ddda38c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:11 devstack sudo[114135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 Jun 27 04:53:11 devstack sudo[114135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:11 devstack sudo[114131]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.818s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleted volume successfully. Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-cce0230d-49c8-4a4c-9ec5-9d6e9148de6a tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-2c7f3d9f-47cf-4c58-9190-a889fb31eb10-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:11 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.info" returned: 0 in 0.824s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:11 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d341f6c6-e8ea-4fa7-a0e3-9cacf45cd234 tempest-VolumeDependencyTests-1905443612 None] Create snapshot completed successfully Jun 27 04:53:12 devstack sudo[114135]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1" returned: 0 in 0.799s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:12 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1 Jun 27 04:53:12 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:13 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-02a63abf-25c9-4f30-b9a1-da34eaed8ee1" returned: 0 in 0.876s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-02a63abf-25c9-4f30-b9a1-da34eaed8ee1" released by "delete_volume" :: held 1.732s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['0519862d-f2df-4dc5-93e1-3d5fab327d3d', '5a5a75ef-7499-4c33-aadd-62dba333b527', '8841a12d-f815-4f8a-b186-c90a8a84f0ba', '0de00eca-5557-4bee-812c-5436b4696ba6'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:13 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:13 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Flow 'volume_create_manager' (f04ac00f-3b7b-4da1-a2aa-3c6bd5f2a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2294be8d-506e-4fe7-8e9a-af06417f7d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2294be8d-506e-4fe7-8e9a-af06417f7d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1286463634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c63a734-1eb8-4537-bae0-55008cd22fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd28beee9f43b9b79c4ad267bf8470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8da7cdfd-c55a-4802-a50d-02905ccbf262,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:13Z,use_quota=True,user_id='d0c6aaf15ccf46be8c7322d36229c4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef54db2-1fc6-459c-bb25-a10949bb024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef54db2-1fc6-459c-bb25-a10949bb024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6ee43a-0f59-4636-9ea3-a8ec1bd4b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6ee43a-0f59-4636-9ea3-a8ec1bd4b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c63a734-1eb8-4537-bae0-55008cd22fec', 'volume_name': 'volume-9c63a734-1eb8-4537-bae0-55008cd22fec', 'volume_size': 1, 'snapshot_id': '8da7cdfd-c55a-4802-a50d-02905ccbf262'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77594e8a-0bed-4afa-bdc2-7e37421c2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77594e8a-0bed-4afa-bdc2-7e37421c2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72716c0-af48-41cb-8be6-ba53d9e03949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:13 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Volume 9c63a734-1eb8-4537-bae0-55008cd22fec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c63a734-1eb8-4537-bae0-55008cd22fec', 'volume_size': 1, 'snapshot_id': '8da7cdfd-c55a-4802-a50d-02905ccbf262'} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-quobyte-8da7cdfd-c55a-4802-a50d-02905ccbf262-9c63a734-1eb8-4537-bae0-55008cd22fec" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-8da7cdfd-c55a-4802-a50d-02905ccbf262-9c63a734-1eb8-4537-bae0-55008cd22fec" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Creating volume 9c63a734-1eb8-4537-bae0-55008cd22fec from snapshot 8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-quobyte-9c63a734-1eb8-4537-bae0-55008cd22fec" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-9c63a734-1eb8-4537-bae0-55008cd22fec" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] snapshot: 8da7cdfd-c55a-4802-a50d-02905ccbf262, volume: 9c63a734-1eb8-4537-bae0-55008cd22fec, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e1f278-a9d8-4e3e-bb67-e38ac19088e9]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-d531509b-f122-44fa-82f9-82cbd37842f3-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-d531509b-f122-44fa-82f9-82cbd37842f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-d531509b-f122-44fa-82f9-82cbd37842f3" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-d531509b-f122-44fa-82f9-82cbd37842f3" acquired by "delete_volume" :: waited 0.026s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:13 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 Jun 27 04:53:13 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[215d36fa-a479-4d09-a765-5fac4b4e9adc]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:14 devstack sudo[114150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 Jun 27 04:53:14 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:14 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.782s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:14 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleted volume successfully. Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1d8f09d9-c78c-4562-94b0-e9a59b828d61 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-02a63abf-25c9-4f30-b9a1-da34eaed8ee1-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:14 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262" returned: 0 in 0.950s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b1cb51-edb1-4346-ba09-65ea66c428ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a954a1c-4af2-4e3b-a047-c01f6500dfbf]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:14 devstack sudo[114159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:14 devstack sudo[114159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:14 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3" returned: 0 in 0.912s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:14 devstack sudo[114162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3 Jun 27 04:53:14 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:15 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-d531509b-f122-44fa-82f9-82cbd37842f3" returned: 0 in 0.778s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-d531509b-f122-44fa-82f9-82cbd37842f3" released by "delete_volume" :: held 1.753s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:15 devstack sudo[114159]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 1.006s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:15 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['45d1b966-4d18-4dbb-bd78-53fb911f06c7', 'c8e5e4d1-87f0-4123-b543-0faf42f4d7d1', '83ec50bc-232f-4127-bffe-2b662443081c', 'bf9267f1-5924-4afd-b45d-0c297a577d7a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:15 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:15 devstack sudo[114170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:15 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-e9656b8e-4db6-4053-b837-3769beac9fbd-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-e9656b8e-4db6-4053-b837-3769beac9fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-059dc435-b153-40b7-a678-80c4e72d00ef" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-059dc435-b153-40b7-a678-80c4e72d00ef" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-e9656b8e-4db6-4053-b837-3769beac9fbd" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-e9656b8e-4db6-4053-b837-3769beac9fbd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleting offline snapshot e9656b8e-4db6-4053-b837-3769beac9fbd of volume 059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] snapshot_file for this snap is: volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3e3fb-39c4-45e6-ac05-2cd2315cc536]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:16 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd Jun 27 04:53:16 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:16 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.909s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:16 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleted volume successfully. Jun 27 04:53:16 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-e7ea6f79-ea80-4692-94f6-0cb47dc6987c tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-d531509b-f122-44fa-82f9-82cbd37842f3-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:17 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd" returned: 0 in 1.533s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:17 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059dc435-b153-40b7-a678-80c4e72d00ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:53:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e2865-eef7-40a4-a201-8a975e81d99a]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:18 devstack sudo[114223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef Jun 27 04:53:18 devstack sudo[114223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:19 devstack sudo[114223]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef" returned: 0 in 1.742s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:19 devstack sudo[114236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd Jun 27 04:53:19 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:20 devstack sudo[114238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:20 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:22 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd" returned: 0 in 2.357s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:22 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd Jun 27 04:53:22 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:22 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.507s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec" returned: 0 in 6.658s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a24b9d6-116a-4d8c-a47f-afa52bb2a852]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:22 devstack sudo[114249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:22 devstack sudo[114249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:22 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef.e9656b8e-4db6-4053-b837-3769beac9fbd" returned: 0 in 0.871s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-e9656b8e-4db6-4053-b837-3769beac9fbd" released by "_delete_snapshot" :: held 6.723s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-059dc435-b153-40b7-a678-80c4e72d00ef" released by "delete_snapshot" :: held 6.767s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['43cd72ba-bb55-4ae2-bc07-f64fea4cb5b9', 'c7d5e6dd-d8aa-4b58-83c8-2b30345ca7d4', 'bc357b85-eb77-448d-b6f6-5c021994029b', '020283bf-7c34-41c8-860b-a44e71de62af'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Delete snapshot completed successfully. Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-eaa55a0e-d711-400f-81e1-4007c26100b1 tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-e9656b8e-4db6-4053-b837-3769beac9fbd-delete_snapshot" released by "delete_snapshot" :: held 6.966s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:23 devstack sudo[114249]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 1.062s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:53:23 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Converted 1024.00 MB image at 153.74 MB/s Jun 27 04:53:23 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec is being set with open permissions: ugo+rw Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:23 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec Jun 27 04:53:23 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-059dc435-b153-40b7-a678-80c4e72d00ef-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-059dc435-b153-40b7-a678-80c4e72d00ef-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "cinder-quobyte-059dc435-b153-40b7-a678-80c4e72d00ef" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-059dc435-b153-40b7-a678-80c4e72d00ef" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d152b0-ef2a-4252-ac30-65c06c9355b3]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:24 devstack sudo[114257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef Jun 27 04:53:24 devstack sudo[114257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:24 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec" returned: 0 in 0.719s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-9c63a734-1eb8-4537-bae0-55008cd22fec" released by "_copy_volume_from_snapshot" :: held 10.534s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-8da7cdfd-c55a-4802-a50d-02905ccbf262-9c63a734-1eb8-4537-bae0-55008cd22fec" released by "_create_volume_from_snapshot" :: held 10.586s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.605s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72716c0-af48-41cb-8be6-ba53d9e03949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c63a734-1eb8-4537-bae0-55008cd22fec', 'volume_size': 1, 'snapshot_id': '8da7cdfd-c55a-4802-a50d-02905ccbf262'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8b4ca9-8b1a-4d5f-aaea-ffcfcc2393cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:24 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Volume volume-9c63a734-1eb8-4537-bae0-55008cd22fec (9c63a734-1eb8-4537-bae0-55008cd22fec): created successfully Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8b4ca9-8b1a-4d5f-aaea-ffcfcc2393cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Flow 'volume_create_manager' (f04ac00f-3b7b-4da1-a2aa-3c6bd5f2a15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:24 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b78197bb-6803-4381-916e-bbc286400426 tempest-VolumeDependencyTests-1905443612 None] Created volume successfully. Jun 27 04:53:24 devstack sudo[114257]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef" returned: 0 in 0.846s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:24 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef Jun 27 04:53:24 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-8da7cdfd-c55a-4802-a50d-02905ccbf262-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-8da7cdfd-c55a-4802-a50d-02905ccbf262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-quobyte-52b1cb51-edb1-4346-ba09-65ea66c428ce" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-52b1cb51-edb1-4346-ba09-65ea66c428ce" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:24 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-quobyte-8da7cdfd-c55a-4802-a50d-02905ccbf262" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-8da7cdfd-c55a-4802-a50d-02905ccbf262" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Deleting offline snapshot 8da7cdfd-c55a-4802-a50d-02905ccbf262 of volume 52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] snapshot_file for this snap is: volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[816af3cb-acef-4157-af99-f7c2bda97272]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:25 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 Jun 27 04:53:25 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:25 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-059dc435-b153-40b7-a678-80c4e72d00ef" returned: 0 in 0.710s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-quobyte-059dc435-b153-40b7-a678-80c4e72d00ef" released by "delete_volume" :: held 1.664s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Created reservations ['dff1b671-d2e1-4487-afee-70a93d1986d6', '28e22d97-bafa-4ec9-a6e4-cfc86f0fe398', 'a8e62c7b-6e48-4778-9f3a-94d35e4499ad', '537bbcb1-4d8b-45ff-8b49-dd4763fae64d'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:25 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:25 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:25 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262" returned: 0 in 0.873s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b1cb51-edb1-4346-ba09-65ea66c428ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d40772-97bf-4ad7-bbf2-efceea8d7fa7]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:25 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:26 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:26 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:26 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.896s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:26 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:26 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Deleted volume successfully. Jun 27 04:53:26 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=124,cinder:UPDATE=184,cinder:DELETE=16,cinder:INSERT=48 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:53:26 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2bad2e04-e8f4-4b94-923b-ebc5e038ecbc tempest-CreateVolumesFromSnapshotTest-18672927 None] Lock "cinder-059dc435-b153-40b7-a678-80c4e72d00ef-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:26 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 0.950s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:26 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:26 devstack sudo[114281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 Jun 27 04:53:26 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:28 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262" returned: 0 in 1.074s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:28 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262 Jun 27 04:53:28 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:28 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce.8da7cdfd-c55a-4802-a50d-02905ccbf262" returned: 0 in 0.787s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=137,cinder:UPDATE=168,cinder:INSERT=44,cinder:DELETE=17 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-8da7cdfd-c55a-4802-a50d-02905ccbf262" released by "_delete_snapshot" :: held 3.819s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-52b1cb51-edb1-4346-ba09-65ea66c428ce" released by "delete_snapshot" :: held 3.874s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:28 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Created reservations ['491ada24-d66c-4088-a891-a36bcbbdccc5', '594dc5be-1b23-4ad6-9d6e-24842658a325', 'd8610f5c-c7eb-47e7-9e38-46b5c4bbd975', '97c32f2b-6a6f-493c-b325-252d35aac6c6'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:29 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Delete snapshot completed successfully. Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9bb72ce9-7205-4f37-99f4-e7e1509001a8 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-8da7cdfd-c55a-4802-a50d-02905ccbf262-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-52b1cb51-edb1-4346-ba09-65ea66c428ce-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-52b1cb51-edb1-4346-ba09-65ea66c428ce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-quobyte-52b1cb51-edb1-4346-ba09-65ea66c428ce" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-52b1cb51-edb1-4346-ba09-65ea66c428ce" acquired by "delete_volume" :: waited 0.019s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a89dd-75d6-4b2a-a870-96570ea64ce1]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:29 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:29 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (f6cccd81-48b4-474c-ac96-76e85921a449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa2aa21-088e-4cbf-a70a-eceff46d2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa2aa21-088e-4cbf-a70a-eceff46d2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1524648592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579df920-1a5d-48ed-930c-59d7903a831e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:30Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aec1b8e-982a-4fb5-8451-3fac1c44d8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aec1b8e-982a-4fb5-8451-3fac1c44d8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c090b4d-bb29-4874-8a6d-cdc25908b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c090b4d-bb29-4874-8a6d-cdc25908b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579df920-1a5d-48ed-930c-59d7903a831e', 'volume_name': 'volume-579df920-1a5d-48ed-930c-59d7903a831e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb238c6b-e5ee-4ec5-948d-d59510f3c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb238c6b-e5ee-4ec5-948d-d59510f3c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1b0833-10bd-4224-8a3b-9f44502c00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:29 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume 579df920-1a5d-48ed-930c-59d7903a831e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579df920-1a5d-48ed-930c-59d7903a831e', 'volume_size': 1} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1524648592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579df920-1a5d-48ed-930c-59d7903a831e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:30Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Creating volume 579df920-1a5d-48ed-930c-59d7903a831e {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:29 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:30 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:30 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:30 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e 1073741824 Jun 27 04:53:30 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:30 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 0.931s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:30 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:30 devstack sudo[114301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce Jun 27 04:53:30 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:31 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e 1073741824" returned: 0 in 1.035s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:31 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e Jun 27 04:53:31 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:31 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-52b1cb51-edb1-4346-ba09-65ea66c428ce" returned: 0 in 0.920s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-52b1cb51-edb1-4346-ba09-65ea66c428ce" released by "delete_volume" :: held 1.945s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Created reservations ['dd5ffab0-fb58-4841-9c04-518fec0c3324', '8b18f4f2-05f9-4c24-84ab-a4478b8131a9', '9358c80b-b252-4367-be19-1be2dbeac497', 'a6f2f184-a2a9-41c1-aaae-b014ad94af78'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:31 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:31 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-9c63a734-1eb8-4537-bae0-55008cd22fec-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-9c63a734-1eb8-4537-bae0-55008cd22fec-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "cinder-quobyte-9c63a734-1eb8-4537-bae0-55008cd22fec" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-9c63a734-1eb8-4537-bae0-55008cd22fec" acquired by "delete_volume" :: waited 0.031s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc27c2-3168-4ff5-918b-4ba49b2fb521]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:31 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:32 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec Jun 27 04:53:32 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:32 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e" returned: 0 in 1.043s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1b0833-10bd-4224-8a3b-9f44502c00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579df920-1a5d-48ed-930c-59d7903a831e', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338bbd17-771f-46c7-b515-ae917744269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:32 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume volume-579df920-1a5d-48ed-930c-59d7903a831e (579df920-1a5d-48ed-930c-59d7903a831e): created successfully Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338bbd17-771f-46c7-b515-ae917744269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (f6cccd81-48b4-474c-ac96-76e85921a449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-54cc6a56-6b91-4304-8a96-cf9d1df6f9b8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created volume successfully. Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.823s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:32 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:32 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Deleted volume successfully. Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-011b8d23-0a4d-419d-bdcf-292bc7a799a4 tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-52b1cb51-edb1-4346-ba09-65ea66c428ce-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:32 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec" returned: 0 in 0.959s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:32 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:32 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec Jun 27 04:53:32 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (1ae337e0-adb0-4de4-af34-0f14d029a7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d2f2a5-e28f-4eab-8930-62c6a978c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d2f2a5-e28f-4eab-8930-62c6a978c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410457170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9456fdd8-5fb2-416c-a50f-f917885137e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:34Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a1d70e-3021-4abf-8c07-e2cea3239c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a1d70e-3021-4abf-8c07-e2cea3239c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65485f95-b76c-4544-9526-50b6073a3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65485f95-b76c-4544-9526-50b6073a3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9456fdd8-5fb2-416c-a50f-f917885137e6', 'volume_name': 'volume-9456fdd8-5fb2-416c-a50f-f917885137e6', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08759572-875b-462b-839c-fe9aefc543ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08759572-875b-462b-839c-fe9aefc543ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ac692d-a7ac-43b1-853a-06275537d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:33 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume 9456fdd8-5fb2-416c-a50f-f917885137e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9456fdd8-5fb2-416c-a50f-f917885137e6', 'volume_size': 1} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410457170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9456fdd8-5fb2-416c-a50f-f917885137e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:34Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Creating volume 9456fdd8-5fb2-416c-a50f-f917885137e6 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:33 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:33 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:33 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 1073741824 Jun 27 04:53:33 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:34 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9c63a734-1eb8-4537-bae0-55008cd22fec" returned: 0 in 1.249s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-quobyte-9c63a734-1eb8-4537-bae0-55008cd22fec" released by "delete_volume" :: held 2.297s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Created reservations ['638504a0-e888-439c-a6b4-b209c4ca7d2b', 'c663ec10-c2a4-4b6e-9d79-2632a93d2c08', 'a67e7304-9141-419e-9380-603ef58cf118', 'bda6000a-90df-4f96-bcbe-e1b8c2f0881f'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (830211a6-98ed-4392-af63-c882563df169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d64757e-4227-44b2-85b9-6dcd6f5ae3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d64757e-4227-44b2-85b9-6dcd6f5ae3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-286184435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959245a2-7150-4993-9b34-eba9ef028fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:34Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f6bb48-aaa6-4bbc-bc78-22b4f482a868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f6bb48-aaa6-4bbc-bc78-22b4f482a868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:34 devstack sudo[114327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:34 devstack sudo[114327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3295dc-eb69-4255-b486-7df972fa04db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3295dc-eb69-4255-b486-7df972fa04db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959245a2-7150-4993-9b34-eba9ef028fa4', 'volume_name': 'volume-959245a2-7150-4993-9b34-eba9ef028fa4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f365f40-d39d-439f-b3da-08ba765aae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f365f40-d39d-439f-b3da-08ba765aae23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bed5106-6970-4770-aee8-ce67ffa9cdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:34 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume 959245a2-7150-4993-9b34-eba9ef028fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959245a2-7150-4993-9b34-eba9ef028fa4', 'volume_size': 1} Jun 27 04:53:34 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (2f40b20a-83a6-4991-a796-1e61aaace651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec17672-ff28-4539-9d4e-e570011e35cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:35 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 1073741824" returned: 0 in 1.356s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec17672-ff28-4539-9d4e-e570011e35cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285717915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19da0179-16d8-4569-a6da-284f1c4aa12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:35Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09d772e-be73-4926-9418-1e30515f29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09d772e-be73-4926-9418-1e30515f29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd69b20-6149-462e-a51d-4a517386c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd69b20-6149-462e-a51d-4a517386c667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19da0179-16d8-4569-a6da-284f1c4aa12c', 'volume_name': 'volume-19da0179-16d8-4569-a6da-284f1c4aa12c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4311091-b802-4511-86ad-ca34fb0ce71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4311091-b802-4511-86ad-ca34fb0ce71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b82f690-42db-4d0c-8653-caff39769334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:35 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume 19da0179-16d8-4569-a6da-284f1c4aa12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19da0179-16d8-4569-a6da-284f1c4aa12c', 'volume_size': 1} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:35 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 Jun 27 04:53:35 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:35 devstack sudo[114327]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.045s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:35 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Deleted volume successfully. Jun 27 04:53:35 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-720d6e60-4ab5-41c7-9e5f-9f04f17211bc tempest-VolumeDependencyTests-1905443612 None] Lock "cinder-9c63a734-1eb8-4537-bae0-55008cd22fec-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Flow 'volume_create_manager' (5beae88c-a0c8-4c4a-a885-8f24afe76fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122b938a-9394-4645-892b-4a780c2b5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122b938a-9394-4645-892b-4a780c2b5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2022316365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d34df52-7207-4eb2-b388-43840939d8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d69a1db7a4495bba8536089f678def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:36Z,use_quota=True,user_id='970bde6410b64ddf990e1a5511fa004a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092fd701-a0c5-43a0-a7a4-214ecf348ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092fd701-a0c5-43a0-a7a4-214ecf348ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce833b1-967a-4c21-8d32-a6f0fd1a6343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce833b1-967a-4c21-8d32-a6f0fd1a6343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d34df52-7207-4eb2-b388-43840939d8a5', 'volume_name': 'volume-9d34df52-7207-4eb2-b388-43840939d8a5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573db450-648a-42f0-88c9-c8da861ae4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573db450-648a-42f0-88c9-c8da861ae4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a68f72-a622-4da5-a48a-19e138a75200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Volume 9d34df52-7207-4eb2-b388-43840939d8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d34df52-7207-4eb2-b388-43840939d8a5', 'volume_size': 1} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:36 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (19ea227b-05df-4981-8c94-0ba5024d773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14222aee-0392-46ab-a348-ab359b61be73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6" returned: 0 in 0.970s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14222aee-0392-46ab-a348-ab359b61be73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087552191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605782d3-7b15-4b9d-8ecc-da6f555b1669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:36Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8f8665-7df0-4c89-aa49-e2e0c5169741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8f8665-7df0-4c89-aa49-e2e0c5169741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46071d98-7b8e-4a12-9906-18495bf85963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46071d98-7b8e-4a12-9906-18495bf85963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605782d3-7b15-4b9d-8ecc-da6f555b1669', 'volume_name': 'volume-605782d3-7b15-4b9d-8ecc-da6f555b1669', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47bd7b3-3aea-44e4-952b-de58943ba22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47bd7b3-3aea-44e4-952b-de58943ba22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c7aa37-e2d3-41cc-9f77-9f92177ebfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume 605782d3-7b15-4b9d-8ecc-da6f555b1669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605782d3-7b15-4b9d-8ecc-da6f555b1669', 'volume_size': 1} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] <== create_volume: return (2518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.521s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-286184435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959245a2-7150-4993-9b34-eba9ef028fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:34Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Creating volume 959245a2-7150-4993-9b34-eba9ef028fa4 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:36 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ac692d-a7ac-43b1-853a-06275537d531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9456fdd8-5fb2-416c-a50f-f917885137e6', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 1073741824 Jun 27 04:53:36 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423909c7-6224-4706-b88d-cdd2ac19287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (579049a3-3b98-4182-88e1-139b4f9388e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba40eea-81e4-4a8a-9ba4-f0dbd04923b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba40eea-81e4-4a8a-9ba4-f0dbd04923b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040238458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920fbb2c-e44c-4791-b1f5-dc32733bad46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:36Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378ca354-763f-466f-88ab-5cd82282101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378ca354-763f-466f-88ab-5cd82282101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df43016-9eea-4b81-a95a-f07483f9c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df43016-9eea-4b81-a95a-f07483f9c475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920fbb2c-e44c-4791-b1f5-dc32733bad46', 'volume_name': 'volume-920fbb2c-e44c-4791-b1f5-dc32733bad46', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a357b6c4-6196-45f9-bb2b-e7f195fe297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a357b6c4-6196-45f9-bb2b-e7f195fe297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a1d289-87cf-420f-91e6-6f4801c57976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:36 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume 920fbb2c-e44c-4791-b1f5-dc32733bad46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920fbb2c-e44c-4791-b1f5-dc32733bad46', 'volume_size': 1} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:36 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume volume-9456fdd8-5fb2-416c-a50f-f917885137e6 (9456fdd8-5fb2-416c-a50f-f917885137e6): created successfully Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (423909c7-6224-4706-b88d-cdd2ac19287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:36 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (1ae337e0-adb0-4de4-af34-0f14d029a7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:36 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ca485528-8d55-4aba-b51b-9093f7834467 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created volume successfully. Jun 27 04:53:37 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 1073741824" returned: 0 in 0.982s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:37 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:37 devstack sudo[114344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 Jun 27 04:53:37 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:38 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4" returned: 0 in 0.707s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.811s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285717915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19da0179-16d8-4569-a6da-284f1c4aa12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:35Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Creating volume 19da0179-16d8-4569-a6da-284f1c4aa12c {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:38 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bed5106-6970-4770-aee8-ce67ffa9cdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959245a2-7150-4993-9b34-eba9ef028fa4', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9190b065-d3f2-4247-91a0-a90bdc673ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:38 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c 1073741824 Jun 27 04:53:38 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:38 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume volume-959245a2-7150-4993-9b34-eba9ef028fa4 (959245a2-7150-4993-9b34-eba9ef028fa4): created successfully Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9190b065-d3f2-4247-91a0-a90bdc673ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:38 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (830211a6-98ed-4392-af63-c882563df169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:38 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f8fb0489-ed89-4239-9800-7592b69b9ff8 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created volume successfully. Jun 27 04:53:39 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c 1073741824" returned: 0 in 0.836s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:39 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c Jun 27 04:53:39 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:39 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c" returned: 0 in 0.631s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.418s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2022316365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d34df52-7207-4eb2-b388-43840939d8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d69a1db7a4495bba8536089f678def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:36Z,use_quota=True,user_id='970bde6410b64ddf990e1a5511fa004a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Creating volume 9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:39 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b82f690-42db-4d0c-8653-caff39769334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19da0179-16d8-4569-a6da-284f1c4aa12c', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:39 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 1073741824 Jun 27 04:53:39 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed9b9c-7b36-4675-935d-dc2712984372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:39 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume volume-19da0179-16d8-4569-a6da-284f1c4aa12c (19da0179-16d8-4569-a6da-284f1c4aa12c): created successfully Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed9b9c-7b36-4675-935d-dc2712984372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:39 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (2f40b20a-83a6-4991-a796-1e61aaace651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:39 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-a539876d-1779-4d60-86fd-08dd6461db46 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created volume successfully. Jun 27 04:53:40 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 1073741824" returned: 0 in 0.856s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:40 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:40 devstack sudo[114361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:53:40 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:41 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 0.649s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.832s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087552191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605782d3-7b15-4b9d-8ecc-da6f555b1669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:36Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Creating volume 605782d3-7b15-4b9d-8ecc-da6f555b1669 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:41 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a68f72-a622-4da5-a48a-19e138a75200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d34df52-7207-4eb2-b388-43840939d8a5', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e64978-f52a-41ca-bc5b-7849626f1240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:41 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 1073741824 Jun 27 04:53:41 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:41 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Volume volume-9d34df52-7207-4eb2-b388-43840939d8a5 (9d34df52-7207-4eb2-b388-43840939d8a5): created successfully Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e64978-f52a-41ca-bc5b-7849626f1240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:41 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Flow 'volume_create_manager' (5beae88c-a0c8-4c4a-a885-8f24afe76fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:41 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-d7317c16-5cee-43d0-a987-26c9619682e3 tempest-SnapshotDependencyTests-1808409511 None] Created volume successfully. Jun 27 04:53:42 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 1073741824" returned: 0 in 0.855s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:42 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 Jun 27 04:53:42 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:42 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669" returned: 0 in 0.681s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.276s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1040238458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920fbb2c-e44c-4791-b1f5-dc32733bad46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03656ae0a34d46bd8e0a109a3bee7416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:36Z,use_quota=True,user_id='074ccc920fbe449ba74790f4a1e0eb5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Creating volume 920fbb2c-e44c-4791-b1f5-dc32733bad46 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:42 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c7aa37-e2d3-41cc-9f77-9f92177ebfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605782d3-7b15-4b9d-8ecc-da6f555b1669', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dfb51b-39f0-4b6c-a77d-fb858ba8c6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:42 devstack sudo[114374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 1073741824 Jun 27 04:53:42 devstack sudo[114374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:42 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 (605782d3-7b15-4b9d-8ecc-da6f555b1669): created successfully Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27dfb51b-39f0-4b6c-a77d-fb858ba8c6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:42 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (19ea227b-05df-4981-8c94-0ba5024d773b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:42 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-c27bdc13-cda5-40d8-a737-bc15b32e6ad6 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created volume successfully. Jun 27 04:53:43 devstack sudo[114374]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 1073741824" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:43 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:43 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 Jun 27 04:53:43 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:44 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46" returned: 0 in 0.660s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.076s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a1d289-87cf-420f-91e6-6f4801c57976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920fbb2c-e44c-4791-b1f5-dc32733bad46', 'volume_size': 1}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10797f9f-2c46-46b6-9fd8-f9f152986219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Creating offline snapshot 234cbde8-f58f-457d-acc3-42e8a70dfa4a of volume 9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Jun 27 04:53:44 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Volume volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 (920fbb2c-e44c-4791-b1f5-dc32733bad46): created successfully Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10797f9f-2c46-46b6-9fd8-f9f152986219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Flow 'volume_create_manager' (579049a3-3b98-4182-88e1-139b4f9388e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf40d9-eec8-4641-bfda-a02908d42d82]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:44 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-ed239b9c-6971-4fd6-8bf2-23bee583917b tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created volume successfully. Jun 27 04:53:44 devstack sudo[114382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:53:44 devstack sudo[114382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-920fbb2c-e44c-4791-b1f5-dc32733bad46-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:44 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-920fbb2c-e44c-4791-b1f5-dc32733bad46-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-quobyte-920fbb2c-e44c-4791-b1f5-dc32733bad46" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-920fbb2c-e44c-4791-b1f5-dc32733bad46" acquired by "delete_volume" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712ae59-ad1d-4a7d-9162-12948f5d15c8]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:45 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 Jun 27 04:53:45 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:45 devstack sudo[114382]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 0.855s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:45 devstack sudo[114389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a 1G Jun 27 04:53:45 devstack sudo[114389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:45 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46" returned: 0 in 0.850s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:45 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:45 devstack sudo[114397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46 Jun 27 04:53:45 devstack sudo[114397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:46 devstack sudo[114389]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a 1G" returned: 0 in 0.892s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d34df52-7207-4eb2-b388-43840939d8a5 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:46 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d34df52-7207-4eb2-b388-43840939d8a5 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a Jun 27 04:53:46 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:46 devstack sudo[114397]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-920fbb2c-e44c-4791-b1f5-dc32733bad46" returned: 0 in 0.661s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-920fbb2c-e44c-4791-b1f5-dc32733bad46" released by "delete_volume" :: held 1.561s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created reservations ['5b14b40a-3835-4283-adc9-57983e09720c', '8a69be2e-4fca-40d4-84b1-c9b909493676', '742a0418-2abb-4794-b5c7-2b457bcde2bc', 'c8b29e7e-e5f0-48f6-8a90-6c854b0bf4aa'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:46 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:46 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:46 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d34df52-7207-4eb2-b388-43840939d8a5 -F qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a" returned: 0 in 0.741s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:46 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a is being set with open permissions: ugo+rw Jun 27 04:53:46 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:46 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a Jun 27 04:53:46 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-605782d3-7b15-4b9d-8ecc-da6f555b1669-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-605782d3-7b15-4b9d-8ecc-da6f555b1669-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-quobyte-605782d3-7b15-4b9d-8ecc-da6f555b1669" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-605782d3-7b15-4b9d-8ecc-da6f555b1669" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[089a9836-6c59-4a63-ad20-a4e78b639e95]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:47 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.696s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:47 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Deleted volume successfully. Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-9a8b6e99-78bf-44e6-abc3-c98447b82879 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-920fbb2c-e44c-4791-b1f5-dc32733bad46-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:47 devstack sudo[114410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 Jun 27 04:53:47 devstack sudo[114410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:47 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a" returned: 0 in 0.695s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:47 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:47 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info Jun 27 04:53:47 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:48 devstack sudo[114410]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:48 devstack sudo[114418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669 Jun 27 04:53:48 devstack sudo[114418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:48 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info" returned: 0 in 0.646s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:48 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info is being set with open permissions: ugo+rw Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:48 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info Jun 27 04:53:48 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:48 devstack sudo[114418]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-605782d3-7b15-4b9d-8ecc-da6f555b1669" returned: 0 in 0.648s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-605782d3-7b15-4b9d-8ecc-da6f555b1669" released by "delete_volume" :: held 1.499s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created reservations ['ac63687b-e773-4b47-b799-db5c44215e2e', 'f4066cf1-81d9-425b-9e0d-694b9c5e7b86', '0eddca93-b5e8-4a87-9f08-86c083e9a8fb', '2bfeef2f-3b63-44c6-99da-3f5bd26e4a6e'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:48 devstack sudo[114425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:48 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:48 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.info" returned: 0 in 0.650s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:48 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-b9718ac7-585f-4474-a787-9b2479a6b396 tempest-SnapshotDependencyTests-1808409511 None] Create snapshot completed successfully Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-19da0179-16d8-4569-a6da-284f1c4aa12c-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-19da0179-16d8-4569-a6da-284f1c4aa12c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-quobyte-19da0179-16d8-4569-a6da-284f1c4aa12c" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-19da0179-16d8-4569-a6da-284f1c4aa12c" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd7f330-2118-4c0d-8a83-0ba4ce1fec69]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:49 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.665s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:49 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Deleted volume successfully. Jun 27 04:53:49 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-3f6e3315-6307-431a-93d2-7c26e557c741 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-605782d3-7b15-4b9d-8ecc-da6f555b1669-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:49 devstack sudo[114428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c Jun 27 04:53:49 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Flow 'volume_create_manager' (4004c217-6d31-4884-80c4-042b705e9200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74598ab-abbd-4258-b4c2-42d7ec148fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74598ab-abbd-4258-b4c2-42d7ec148fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b756d5dc-9ef1-445a-ab9c-9ba591576dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62d69a1db7a4495bba8536089f678def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=234cbde8-f58f-457d-acc3-42e8a70dfa4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:53:50Z,use_quota=True,user_id='970bde6410b64ddf990e1a5511fa004a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd6f221-aec8-4d1b-8184-1697687490a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd6f221-aec8-4d1b-8184-1697687490a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d49dcba-b5bf-4817-a661-17cb383b25b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d49dcba-b5bf-4817-a661-17cb383b25b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b756d5dc-9ef1-445a-ab9c-9ba591576dbe', 'volume_name': 'volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe', 'volume_size': 1, 'snapshot_id': '234cbde8-f58f-457d-acc3-42e8a70dfa4a'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544e0a22-d791-4da5-8785-4fb12d988135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544e0a22-d791-4da5-8785-4fb12d988135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cefccc-4da0-4feb-a0f2-75257feca127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:50 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Volume b756d5dc-9ef1-445a-ab9c-9ba591576dbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe', 'volume_size': 1, 'snapshot_id': '234cbde8-f58f-457d-acc3-42e8a70dfa4a'} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-quobyte-234cbde8-f58f-457d-acc3-42e8a70dfa4a-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" by "_create_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-234cbde8-f58f-457d-acc3-42e8a70dfa4a-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Creating volume b756d5dc-9ef1-445a-ab9c-9ba591576dbe from snapshot 234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-quobyte-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" by "_copy_volume_from_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:50 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] snapshot: 234cbde8-f58f-457d-acc3-42e8a70dfa4a, volume: b756d5dc-9ef1-445a-ab9c-9ba591576dbe, {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c" returned: 0 in 0.814s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:50 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c Jun 27 04:53:50 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0e7398-d3bb-4b2a-b6cf-961980221032]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:50 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:50 devstack sudo[114435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a Jun 27 04:53:50 devstack sudo[114435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:51 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-19da0179-16d8-4569-a6da-284f1c4aa12c" returned: 0 in 0.650s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-19da0179-16d8-4569-a6da-284f1c4aa12c" released by "delete_volume" :: held 1.529s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created reservations ['2c261a58-320f-4e56-8853-eda225354412', 'bf0fa684-8696-4e6a-8b26-9f26a768e671', '6266ae7e-9de0-4e23-b3ef-768cf957ed71', '825dd620-0e48-4d86-85a9-283cf95f0518'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:51 devstack sudo[114442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:51 devstack sudo[114442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:51 devstack sudo[114435]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d34df52-7207-4eb2-b388-43840939d8a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Creating direct copy from snapshot {{(pid=93772) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e344d25-07ec-4a95-ac0a-f5452050a90c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:51 devstack sudo[114444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:53:51 devstack sudo[114444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-959245a2-7150-4993-9b34-eba9ef028fa4-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-959245a2-7150-4993-9b34-eba9ef028fa4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-quobyte-959245a2-7150-4993-9b34-eba9ef028fa4" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-959245a2-7150-4993-9b34-eba9ef028fa4" acquired by "delete_volume" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ccdc21-d938-46dc-a1ca-2510923f5b6d]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:51 devstack sudo[114442]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.720s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:51 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 Jun 27 04:53:51 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Deleted volume successfully. Jun 27 04:53:51 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:51 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-def87c60-cb38-4f0e-aa12-5544ee7250a1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-19da0179-16d8-4569-a6da-284f1c4aa12c-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:52 devstack sudo[114444]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 0.847s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:52 devstack cinder-volume[93772]: DEBUG cinder.utils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Path /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe not found in is_blk_device check {{(pid=93772) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Jun 27 04:53:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:52 devstack sudo[114453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe Jun 27 04:53:52 devstack sudo[114453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:52 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4" returned: 0 in 0.905s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:52 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:52 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4 Jun 27 04:53:52 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:54 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:54 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-959245a2-7150-4993-9b34-eba9ef028fa4" returned: 0 in 1.963s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:54 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-959245a2-7150-4993-9b34-eba9ef028fa4" released by "delete_volume" :: held 2.945s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:54 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created reservations ['fd2456c1-88af-41b3-8815-16766009ab32', '48bcf66c-52af-4447-80f0-8571a23e54da', 'b20993b1-05a2-4de5-9255-4f877ce96eb5', '9d593fae-8920-4e36-8039-55d082aa60b1'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:55 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:55 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-9456fdd8-5fb2-416c-a50f-f917885137e6-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-9456fdd8-5fb2-416c-a50f-f917885137e6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-quobyte-9456fdd8-5fb2-416c-a50f-f917885137e6" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-9456fdd8-5fb2-416c-a50f-f917885137e6" acquired by "delete_volume" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebd9c4-6439-4665-8717-2ef3b7eac62e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:55 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:55 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 Jun 27 04:53:55 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:56 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:56 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 1.212s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:56 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:56 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Deleted volume successfully. Jun 27 04:53:56 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-50073259-79de-43dc-a608-f5ccd14c02e1 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-959245a2-7150-4993-9b34-eba9ef028fa4-delete_volume" released by "delete_volume" :: held 4.688s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:57 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6" returned: 0 in 1.616s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:57 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6 Jun 27 04:53:57 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:57 devstack sudo[114453]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" returned: 0 in 5.526s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:57 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc803286-1a75-4553-9acf-c22729a2d732]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:57 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:57 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:53:57 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:58 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9456fdd8-5fb2-416c-a50f-f917885137e6" returned: 0 in 0.729s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-9456fdd8-5fb2-416c-a50f-f917885137e6" released by "delete_volume" :: held 2.441s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created reservations ['f3981b3d-4819-4352-96cf-f294f18d60f0', '0d5cf855-8efd-4672-80fc-24401f9eba8e', '65dec479-b7c1-4862-98f4-37c31f065de3', 'f16f0ac6-ea1b-4509-a737-82f9246df4f1'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:58 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:53:58 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:58 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 1.002s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Image conversion details: src /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:53:58 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Converted 1024.00 MB image at 185.25 MB/s Jun 27 04:53:58 devstack cinder-volume[93772]: WARNING cinder.volume.drivers.remotefs [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe is being set with open permissions: ugo+rw Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:58 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe Jun 27 04:53:58 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-579df920-1a5d-48ed-930c-59d7903a831e-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-579df920-1a5d-48ed-930c-59d7903a831e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "cinder-quobyte-579df920-1a5d-48ed-930c-59d7903a831e" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-579df920-1a5d-48ed-930c-59d7903a831e" acquired by "delete_volume" :: waited 0.014s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f75e2-2ffa-4be1-89d5-d996e258b23e]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:58 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.735s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:58 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:53:58 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Deleted volume successfully. Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f0e52e59-d4a5-4ddd-84eb-d2aff468501e tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-9456fdd8-5fb2-416c-a50f-f917885137e6-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:59 devstack sudo[114493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e Jun 27 04:53:59 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:53:59 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" returned: 0 in 0.697s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" released by "_copy_volume_from_snapshot" :: held 9.014s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-234cbde8-f58f-457d-acc3-42e8a70dfa4a-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" released by "_create_volume_from_snapshot" :: held 9.051s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.070s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cefccc-4da0-4feb-a0f2-75257feca127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe', 'volume_size': 1, 'snapshot_id': '234cbde8-f58f-457d-acc3-42e8a70dfa4a'}' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0399fd5c-3d56-4b93-8435-c6586b8ae812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:53:59 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Volume volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe (b756d5dc-9ef1-445a-ab9c-9ba591576dbe): created successfully Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0399fd5c-3d56-4b93-8435-c6586b8ae812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Flow 'volume_create_manager' (4004c217-6d31-4884-80c4-042b705e9200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:53:59 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-24e92143-58eb-4f9b-b68a-9a2124820a6d tempest-SnapshotDependencyTests-1808409511 None] Created volume successfully. Jun 27 04:53:59 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e" returned: 0 in 0.758s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:53:59 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:53:59 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e Jun 27 04:53:59 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:00 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-579df920-1a5d-48ed-930c-59d7903a831e" returned: 0 in 0.632s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-quobyte-579df920-1a5d-48ed-930c-59d7903a831e" released by "delete_volume" :: held 1.436s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-234cbde8-f58f-457d-acc3-42e8a70dfa4a-delete_snapshot" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Created reservations ['783aa1ac-fd7f-4a22-b886-ef45973b0726', '4153a7c7-f181-4640-8cc2-5c1252800023', '30df049d-37e2-4ba6-af11-89a4d89b4395', '9a46164f-5646-4783-801c-df8d9852cef5'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-234cbde8-f58f-457d-acc3-42e8a70dfa4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-quobyte-9d34df52-7207-4eb2-b388-43840939d8a5" by "delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-9d34df52-7207-4eb2-b388-43840939d8a5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-quobyte-234cbde8-f58f-457d-acc3-42e8a70dfa4a" by "_delete_snapshot" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-234cbde8-f58f-457d-acc3-42e8a70dfa4a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Deleting offline snapshot 234cbde8-f58f-457d-acc3-42e8a70dfa4a of volume 9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] snapshot_file for this snap is: volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea384dc-9a6d-46b0-a5a7-605e67e92006]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:00 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:00 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:54:00 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:00 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a Jun 27 04:54:00 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:01 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.791s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:01 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a" returned: 0 in 0.835s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d34df52-7207-4eb2-b388-43840939d8a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93772) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 27 04:54:01 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Deleted volume successfully. Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc2e32d-a681-4ec2-80dc-be83febf176c]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:01 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-f7cf284f-2c8b-4f9f-bd96-c76d49059ee3 tempest-CreateVolumesFromSourceVolumeTest-1280551361 None] Lock "cinder-579df920-1a5d-48ed-930c-59d7903a831e-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:01 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:54:01 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:02 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 0.897s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:02 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:02 devstack sudo[114517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a Jun 27 04:54:02 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:03 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a" returned: 0 in 0.875s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:03 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a Jun 27 04:54:03 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:03 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:03 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5.234cbde8-f58f-457d-acc3-42e8a70dfa4a" returned: 0 in 0.694s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-234cbde8-f58f-457d-acc3-42e8a70dfa4a" released by "_delete_snapshot" :: held 3.419s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:03 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-9d34df52-7207-4eb2-b388-43840939d8a5" released by "delete_snapshot" :: held 3.444s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:03 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Created reservations ['94fc20f6-c8f4-480f-8b7f-9c0b8168fb76', 'a726ee97-3509-4436-97ab-f7d8a8b5b162', '8574ce9f-8ba6-4a94-bee1-f246ecb63891', 'b94db269-8a53-480d-97b5-a4cf1ef8f92a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:54:04 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Delete snapshot completed successfully. Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-2b5888ca-939e-4c74-9d0a-ff10003691d3 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-234cbde8-f58f-457d-acc3-42e8a70dfa4a-delete_snapshot" released by "delete_snapshot" :: held 3.617s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-9d34df52-7207-4eb2-b388-43840939d8a5-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-9d34df52-7207-4eb2-b388-43840939d8a5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-quobyte-9d34df52-7207-4eb2-b388-43840939d8a5" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-9d34df52-7207-4eb2-b388-43840939d8a5" acquired by "delete_volume" :: waited 0.022s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[0674ab3d-b6dc-4da8-b3e5-53aa05176e09]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:04 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:04 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:54:04 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:05 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 0.881s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:05 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:05 devstack sudo[114530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5 Jun 27 04:54:05 devstack sudo[114530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:06 devstack sudo[114530]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9d34df52-7207-4eb2-b388-43840939d8a5" returned: 0 in 0.703s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-9d34df52-7207-4eb2-b388-43840939d8a5" released by "delete_volume" :: held 1.652s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Created reservations ['ca62eab0-051c-42d5-987c-b9c0df711847', '2df58828-1832-47d5-a2da-03c34029f8a2', 'e2602f4e-7aba-4bd2-974c-66487df98a04', '206c858f-b365-40e6-bead-d2bda357585a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:06 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:54:06 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93772) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Flow 'volume_create_manager' (21c6daa4-9079-44e8-9a49-dd9e502a37e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1ecfa8-2b3a-4211-bfa7-45383b7338a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-b756d5dc-9ef1-445a-ab9c-9ba591576dbe-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1ecfa8-2b3a-4211-bfa7-45383b7338a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b82fbc0-6b46-4375-bed4-883939d12f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf8ef3423e4d788191d40380001a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:54:07Z,use_quota=True,user_id='f24f1b5d308d48f38f2cadd46a93a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b0c39d-86fe-4117-8d99-9af54f72271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b0c39d-86fe-4117-8d99-9af54f72271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3071c09-8950-4acd-9adb-7eaad5848d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.image.glance [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Creating Keystone auth plugin from conf {{(pid=93772) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 27 04:54:06 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-b756d5dc-9ef1-445a-ab9c-9ba591576dbe-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "cinder-quobyte-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" acquired by "delete_volume" :: waited 0.021s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[055fb991-114f-453a-862a-758e04caa26b]: (4, 'qcow2') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:07 devstack sudo[114535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe Jun 27 04:54:07 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3071c09-8950-4acd-9adb-7eaad5848d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b82fbc0-6b46-4375-bed4-883939d12f28', 'volume_name': 'volume-9b82fbc0-6b46-4375-bed4-883939d12f28', 'volume_size': 1, 'image_id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e46acec8593f7923a757456abddf7bf0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0dcf8ef3423e4d788191d40380001a36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c74d8b58864c5ac1f82b56de2e7eb8ebef8d2b17504d814e5e7ee59005884893b447ec2fe55500ab83d853ac013998e0963b793d6af82d9730ab4a43aa2fd13', 'id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'created_at': datetime.datetime(2026, 6, 27, 2, 54, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd/file', 'properties': {}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff7676d-38a1-499d-9e9e-e6822665f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff7676d-38a1-499d-9e9e-e6822665f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e864272d-e82c-4a9d-98ff-705588215268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:54:07 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Volume 9b82fbc0-6b46-4375-bed4-883939d12f28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b82fbc0-6b46-4375-bed4-883939d12f28', 'volume_size': 1, 'image_id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e46acec8593f7923a757456abddf7bf0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0dcf8ef3423e4d788191d40380001a36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c74d8b58864c5ac1f82b56de2e7eb8ebef8d2b17504d814e5e7ee59005884893b447ec2fe55500ab83d853ac013998e0963b793d6af82d9730ab4a43aa2fd13', 'id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'created_at': datetime.datetime(2026, 6, 27, 2, 54, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd/file', 'properties': {}}, 'image_service': } Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Trying to clone 9b82fbc0-6b46-4375-bed4-883939d12f28 from image ec1b2c52-32dc-480f-ac28-012b9110bcdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'metadata': {}}]). {{(pid=93772) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Jun 27 04:54:07 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.762s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:54:07 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Deleted volume successfully. Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-486cc731-9ce9-4260-a320-d03f31930d70 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-9d34df52-7207-4eb2-b388-43840939d8a5-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Jun 27 04:54:07 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Image download 0.00 MB at 0.00 MB/s Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610b064-4f7e-4e8a-8392-0124df1ef964]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:07 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD Jun 27 04:54:07 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:07 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" returned: 0 in 0.822s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:07 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:07 devstack sudo[114544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe Jun 27 04:54:07 devstack sudo[114544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:08 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:08 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD Jun 27 04:54:08 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:08 devstack sudo[114544]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" returned: 0 in 0.691s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-quobyte-b756d5dc-9ef1-445a-ab9c-9ba591576dbe" released by "delete_volume" :: held 1.588s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Created reservations ['78015041-ac81-45da-a623-1d24272272b9', '3fc8c5c8-0f7f-454e-bd34-bb55f8ce456f', '296aed97-e34e-4aa2-a704-337d210c7da3', 'b37ea520-80b0-49e8-96ac-a1d268b53b35'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:08 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:08 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:54:08 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:08 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Temporary image ec1b2c52-32dc-480f-ac28-012b9110bcdd is fetched for user f24f1b5d308d48f38f2cadd46a93a1cc. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf603d7-12ae-484c-af0f-fa5a7a044294]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:09 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD Jun 27 04:54:09 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:09 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.700s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:54:09 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Deleted volume successfully. Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-4fd2d6d5-245f-4b43-859f-def119bf15f7 tempest-SnapshotDependencyTests-1808409511 None] Lock "cinder-b756d5dc-9ef1-445a-ab9c-9ba591576dbe-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:09 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:09 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:09 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD Jun 27 04:54:09 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:10 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-27T02:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b82fbc0-6b46-4375-bed4-883939d12f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dcf8ef3423e4d788191d40380001a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-27T02:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-27T02:54:07Z,use_quota=True,user_id='f24f1b5d308d48f38f2cadd46a93a1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f729947a-ffab-4797-b95a-5accbe197bbd),volume_type_id=f729947a-ffab-4797-b95a-5accbe197bbd)}" {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.remotefs [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Creating volume 9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Selected osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 as target Quobyte volume. {{(pid=93772) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 27 04:54:10 devstack cinder-volume[93772]: INFO cinder.volume.drivers.remotefs [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] casted to osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350 Jun 27 04:54:10 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 1073741824 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:10 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 1073741824 Jun 27 04:54:10 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:11 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 1073741824" returned: 0 in 0.882s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:11 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:11 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:11 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:12 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 0 in 0.842s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:12 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'} {{(pid=93772) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Jun 27 04:54:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:12 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Attempting download of ec1b2c52-32dc-480f-ac28-012b9110bcdd ((None, [{'url': 'file:///opt/stack/data/glance/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'metadata': {}}])) to volume 9b82fbc0-6b46-4375-bed4-883939d12f28. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Jun 27 04:54:12 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[842698d1-7267-4ec6-aeca-a445d89bc433]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:12 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:12 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk Jun 27 04:54:12 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:13 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk" returned: 0 in 0.895s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:13 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:13 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk Jun 27 04:54:13 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:14 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk" returned: 1 in 0.781s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec1b2c52-32dc-480f-ac28-012b9110bcdd__a3w8bkk' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:54:14 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[be804267-c902-4dfc-afb9-833868049b5b]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:14 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:14 devstack sudo[114586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD Jun 27 04:54:14 devstack sudo[114586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:15 devstack sudo[114586]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:15 devstack sudo[114591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD Jun 27 04:54:15 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:15 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD" returned: 1 in 0.800s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:54:15 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] ec1b2c52-32dc-480f-ac28-012b9110bcdd was raw, converting to raw {{(pid=93772) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Jun 27 04:54:15 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:15 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:15 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:16 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 0 in 0.873s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:16 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec1b2c52-32dc-480f-ac28-012b9110bcdd_lc6v42ktdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Jun 27 04:54:16 devstack cinder-volume[93772]: INFO cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Converted 0.00 MB image at 0.00 MB/s Jun 27 04:54:16 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 1G {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:16 devstack sudo[114601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 1G Jun 27 04:54:16 devstack sudo[114601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:17 devstack sudo[114601]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 1G" returned: 0 in 0.808s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:17 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171a72c-98cd-4615-8905-b623d516135e]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:17 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:17 devstack sudo[114607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:17 devstack sudo[114607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:18 devstack sudo[114607]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 0 in 0.820s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:18 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:18 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:18 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:19 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 1 in 0.841s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Downloaded image ec1b2c52-32dc-480f-ac28-012b9110bcdd ((None, [{'url': 'file:///opt/stack/data/glance/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'metadata': {}}])) to volume 9b82fbc0-6b46-4375-bed4-883939d12f28 successfully. {{(pid=93772) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.image.image_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Temporary image ec1b2c52-32dc-480f-ac28-012b9110bcdd for user f24f1b5d308d48f38f2cadd46a93a1cc is deleted. {{(pid=93772) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.volume_utils [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Marking volume 9b82fbc0-6b46-4375-bed4-883939d12f28 as bootable. {{(pid=93772) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Copying metadata from image ec1b2c52-32dc-480f-ac28-012b9110bcdd to 9b82fbc0-6b46-4375-bed4-883939d12f28. {{(pid=93772) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.flows.manager.create_volume [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Creating volume glance metadata for volume 9b82fbc0-6b46-4375-bed4-883939d12f28 backed by image ec1b2c52-32dc-480f-ac28-012b9110bcdd with: {'image_id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e46acec8593f7923a757456abddf7bf0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93772) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e864272d-e82c-4a9d-98ff-705588215268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b82fbc0-6b46-4375-bed4-883939d12f28', 'volume_size': 1, 'image_id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e46acec8593f7923a757456abddf7bf0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0dcf8ef3423e4d788191d40380001a36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3c74d8b58864c5ac1f82b56de2e7eb8ebef8d2b17504d814e5e7ee59005884893b447ec2fe55500ab83d853ac013998e0963b793d6af82d9730ab4a43aa2fd13', 'id': 'ec1b2c52-32dc-480f-ac28-012b9110bcdd', 'created_at': datetime.datetime(2026, 6, 27, 2, 54, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 27, 2, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec1b2c52-32dc-480f-ac28-012b9110bcdd/file', 'properties': {}}, 'image_service': }' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cbac3b-af46-4986-b64e-568d0ef065ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 27 04:54:19 devstack cinder-volume[93772]: INFO cinder.volume.flows.manager.create_volume [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Volume volume-9b82fbc0-6b46-4375-bed4-883939d12f28 (9b82fbc0-6b46-4375-bed4-883939d12f28): created successfully Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cbac3b-af46-4986-b64e-568d0ef065ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93772) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Flow 'volume_create_manager' (21c6daa4-9079-44e8-9a49-dd9e502a37e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93772) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 27 04:54:19 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-4122705a-489c-4abb-89ac-b2db11be0bd1 tempest-VolumeImageDependencyTests-2087421758 None] Created volume successfully. Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Acquiring lock "cinder-9b82fbc0-6b46-4375-bed4-883939d12f28-delete_volume" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Lock "cinder-9b82fbc0-6b46-4375-bed4-883939d12f28-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Acquiring lock "cinder-quobyte-9b82fbc0-6b46-4375-bed4-883939d12f28" by "delete_volume" {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Lock "cinder-quobyte-9b82fbc0-6b46-4375-bed4-883939d12f28" acquired by "delete_volume" :: waited 0.016s {{(pid=93772) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029e020-c2bf-4fbd-af59-73b5a64986e3]: (4, 'raw') {{(pid=94990) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 27 04:54:19 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:20 devstack sudo[114658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:20 devstack sudo[114658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:20 devstack sudo[114658]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_service.periodic_task [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 0 in 0.800s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:20 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:20 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:54:20 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:20 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:20 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:21 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.798s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:21 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-abe632ec-8789-4a8d-a32a-32549b9be557 None None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:54:21 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 1 in 0.802s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28' failed. Not Retrying. {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 27 04:54:21 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:21 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28 Jun 27 04:54:21 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:22 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58/volume-9b82fbc0-6b46-4375-bed4-883939d12f28" returned: 0 in 0.730s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Lock "cinder-quobyte-9b82fbc0-6b46-4375-bed4-883939d12f28" released by "delete_volume" :: held 2.396s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG cinder.quota [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Created reservations ['b4393e3d-809f-4c83-9fb2-de63c9b21e1c', 'a099fe9e-e444-47ca-a4d4-358bf60020cd', '242ab4ef-c45f-4a5b-afdf-f3c0f74b8a06', '57e29c4f-cb83-4f0a-ae43-c878f8898c9a'] {{(pid=93772) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350': None} {{(pid=93772) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f59aa030-de13-4e50-9866-d0fbbc529350'] {{(pid=93772) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.lockutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93772) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 27 04:54:22 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 27 04:54:22 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58 Jun 27 04:54:22 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 27 04:54:23 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Jun 27 04:54:23 devstack cinder-volume[93772]: DEBUG oslo_concurrency.processutils [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/188345d37bde1002537d7d990da5bc58" returned: 0 in 0.782s {{(pid=93772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 27 04:54:23 devstack cinder-volume[93772]: DEBUG cinder.manager [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Notifying Schedulers of capabilities ... {{(pid=93772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Jun 27 04:54:23 devstack cinder-volume[93772]: INFO cinder.volume.manager [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Deleted volume successfully. Jun 27 04:54:23 devstack cinder-volume[93772]: DEBUG cinder.coordination [None req-1f2e2c36-578b-4c28-8caa-4961798d41ab tempest-VolumeImageDependencyTests-2087421758 None] Lock "cinder-9b82fbc0-6b46-4375-bed4-883939d12f28-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=93772) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 27 04:54:32 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=84,cinder:INSERT=36,cinder:UPDATE=119,cinder:DELETE=9 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 27 04:54:33 devstack cinder-volume[93772]: DEBUG dbcounter [-] [93772] Writing DB stats cinder:SELECT=103,cinder:UPDATE=138,cinder:INSERT=34,cinder:DELETE=12 {{(pid=93772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}